368657623a
Extend add_fdbclient_test to support multiple processes' cluster
2021-07-14 20:17:12 +00:00
475abe301c
Merge remote-tracking branch 'origin/master' into fix-ub
2021-07-14 10:47:02 -07:00
c42815f15f
Merge pull request #5127 from vishesh/cherrypick
...
Making it possible to run a multiple-cluster Java integration test (cherry-pick of #4456 from 6.3)
2021-07-13 09:14:20 -07:00
7b590c2447
Add support for building on Windows via Docker
...
- Add Dockerfile.windows and Dockerfile..windows.devel
- build.ps1: script that produces the binaries (MSI, tools)
- CMake: disable building documentation on windows (not supported)
- Fix invalid path when building setup with WIX
- Remove deprecated @Action attribute from wix project
2021-07-08 11:42:16 +02:00
d1db0d4013
Making it possible to run a multiple-cluster Java integration test
2021-07-07 10:15:18 -07:00
2da4a4ee6f
Add target to build unversioned correctness pkgs
2021-06-29 15:40:59 -06:00
1d38795a46
Properly enable santizers in RocksDB build
2021-06-23 13:58:36 -04:00
c9b06839fc
Halt on error in ubsan for ctest tests
2021-06-23 09:25:51 -07:00
153de33f57
Revert "Merge pull request #4802 from sfc-gh-ljoswiak/revert/actor-lineage"
...
This reverts commit 6499fa178e1512631957
2021-06-04 13:31:55 -07:00
061afda2ec
Fix several package issues ( #4801 )
...
* Make the structure of the server pkg match 6.2.28
* Fix OSX lib path
* Fix install destinations in client
Previously, backup_agent would map to fdbmonitor installation dir -
which is incorrect in the sense that it disagrees with where the default
foundationdb.conf expects to find backup_agent. Add a new backupagent
installation dir and install there, matching foundationdb.conf's
expectations.
Also fix an issue where several of the versions of fdbbackup weren't
being installed
* Update packaging/osx/buildpkg.sh for cmake
* Update README instructions for pkg file
* Remove osx cpack config
* Remove pm install destinations
* Fix weird syntax
* Remove cpack reference to PM
* Address review comments
2021-05-12 11:41:26 -05:00
4ea760b2a9
Revert "Merge pull request #4136 from sfc-gh-mpilman/features/actor-lineage"
...
This reverts commit da41534618e6300905d6
2021-05-10 20:26:12 -07:00
b194a313d8
Merge pull request #4746 from sfc-gh-ljoswiak/fixes/boost
...
Fix boost download links
2021-05-05 16:05:34 -07:00
a274c4768d
Fix remaining download links
2021-05-05 15:51:00 -07:00
f2b70011cc
Fix msgpack dependency
2021-05-04 15:59:08 -07:00
8dcd779fc4
Merge branch 'master' into features/actor-lineage
2021-05-02 14:11:42 -07:00
41e0eac450
Fix the data dir for DEB and EL7 to be /usr/lib/foundationdb/data
...
Also remove the unused legacy mapping for install dirs
2021-04-29 21:25:55 +00:00
4fab2ecd30
Merge remote-tracking branch 'origin/master' into features/actor-lineage
2021-04-28 09:20:54 -06:00
b39b2b4a3c
Initial Container structure, build images from build_output/packages/
2021-04-23 15:33:01 -07:00
8a00c6cdf8
Add -Wshift-sign-overflow
...
This catches the bug fixed in #4656 at compile time
2021-04-21 23:49:26 +00:00
c8b8e8cf7d
Fix msgpack install
2021-04-14 11:27:01 -07:00
2064903705
collect and serialize
2021-04-09 14:25:11 -06:00
da5930171e
Fix boost build on OS X
2021-03-25 11:30:22 -07:00
0ba99c8e83
Pretty-print topology when starting simulation
2021-03-23 09:38:07 -06:00
2cd3f45fd6
Merge remote-tracking branch 'apple/release-6.3' into master-format-final
...
release-6.3 was recently merged, and there were two PRs which were
merged in between and got those changes in here. Hence, since all the
changes were in, discarded the incoming changes and accepted all
current.
2021-03-10 16:50:44 -08:00
ccc8404faa
Disable go bindings for sanitizer builds
2021-03-09 20:55:41 +00:00
b5084c634d
Inform boost context of valgrind usage
...
This fixes the "client switching stacks?" warning that valgrind is
currently issuing.
Also fix a memory error that currently doesn't manifest because of the
way FastAllocator works (if you free a small buffer and then immediately
allocate the same size buffer in FastAllocator you always get the same
buffer back). You can see it if you set FDB_VALGRIND_PRECISE= (causes
FastAllocator to use malloc)
Also minor refactoring and cleanup of CoroFlow.actor.cpp
Also (probably) fix the other sanitizer builds, although I didn't test
that
2021-03-09 01:33:32 +00:00
1510c97085
fix debian packages
2021-03-02 12:41:21 -07:00
c848ae4cda
cmake: skip jemalloc on FreeBSD
...
FreeBSD is the upstream for jemalloc so it's the system malloc already
2021-02-22 16:15:02 +00:00
a3bd2652c2
revert compile boost to old behavior for windows
2021-02-17 09:30:32 -07:00
d13e240496
use libcoroutine for Windows
...
The Windows CI still doesn't have boost context installed
so we use the old implementation for now
2021-02-17 09:23:41 -07:00
f514194aec
Merge remote-tracking branch 'origin/master' into features/coroutine2
2021-02-17 09:03:07 -07:00
601a548cfe
Revert "Move new config to config.h.cmake"
...
This reverts commit 2951ebb4e7
2021-02-08 14:01:02 -08:00
2951ebb4e7
Move new config to config.h.cmake
2021-02-08 13:34:17 -08:00
85ec192169
Remove bad merge line
2021-02-08 13:02:55 -08:00
aaf0a9aa7b
Merge branch 'release-6.3' into merge-release-6.3-into-master
...
# Conflicts:
# build/docker-compose.yaml
# cmake/ConfigureCompiler.cmake
# fdbclient/FileBackupAgent.actor.cpp
# fdbrpc/AsyncFileCached.actor.h
# fdbrpc/IAsyncFile.h
# fdbrpc/IRateControl.h
# fdbrpc/simulator.h
# fdbserver/KeyValueStoreSQLite.actor.cpp
# fdbserver/storageserver.actor.cpp
# fdbservice/ServiceBase.cpp
2021-02-08 12:58:34 -08:00
b70c69e099
Address review note that some variables need to be set earlier.
2021-02-08 10:42:07 -08:00
c2fa9b100d
fix bootstrap command arguments
2021-02-08 10:30:18 -07:00
6e571ab87b
Merge branch 'master' of github.com:apple/foundationdb into features/coroutine2
2021-02-08 10:25:29 -07:00
67e783acf8
Merge branch 'release-6.2' into merge-release-6.2-into-release-6.3
...
# Conflicts:
# cmake/CompileBoost.cmake
# cmake/FDBComponents.cmake
# fdbrpc/AsyncFileCached.actor.h
# fdbrpc/simulator.h
# fdbserver/KeyValueStoreSQLite.actor.cpp
# fdbserver/Knobs.cpp
# fdbserver/Knobs.h
# fdbserver/storageserver.actor.cpp
# flow/Knobs.h
# flow/network.h
2021-02-08 09:20:28 -08:00
c357b36f9a
Merge pull request #4277 from sfc-gh-mpilman/bugfix/fix-jemalloc-link-order
...
Fix order of jemalloc libraries
2021-02-06 21:03:55 -05:00
75f8725392
Add test for using an external client
2021-02-05 01:24:45 +00:00
9b2bab96f1
add comment explaining the change
2021-02-04 15:39:42 -07:00
aae947ad0b
Fix order of jemalloc libraries
...
PIC library has to be first
2021-02-04 15:13:41 -07:00
e4a55908ff
Merge pull request #4222 from sfc-gh-mpilman/features/jemalloc
...
Replace standard malloc with jemalloc
2021-02-04 12:47:29 -08:00
7b489da13b
introduce USE_JEMALLOC and some refactoring
2021-02-04 11:53:28 -07:00
f4370adfcb
use INTERFACE for interface target
2021-02-04 11:22:45 -07:00
04f6a3bb00
fixed broken CompileBoost.cmake
2021-02-02 08:58:42 -07:00
54e20873b7
Don't attempt download&compile of boost on WIN32
...
This takes forever on Windows and we want to only
support docker anyways. Currently boost compilation
on Windows doesn't work properly and it's probably
not worth fixing this
2021-02-01 16:29:02 -07:00
0805902770
Merge branch 'release-6.2' of github.com:apple/foundationdb into features/add-jemalloc-boost
2021-02-01 11:27:12 -07:00
ff0667b28d
winbuild: define BOOST_USE_WINDOWS_H, WIN32_LEAN_AND_MEAN and NOMINMAX to fix various macro expansions issues
...
- NOMINMAX to fix confusion between std::max(..) and max(..) macro redefinition
- BOOST_USE_WINDOWS_H to prevent boost from redefining win32 APIs
- WIN32_LEAN_AND_MEAN to fix include ordering issues with winsock.h
2021-01-30 15:15:02 +01:00
8bec456591
find boost in docker image
2021-01-29 11:51:38 -07:00
5dea9caedb
use BOOST_ROOT (for backwards compatability)
2021-01-28 09:25:26 -07:00
7c64e3943b
compile boost for sanitizers
2021-01-27 19:13:02 -07:00
0696c2d9b4
several bug fixes
2021-01-27 18:22:48 -07:00
1f8222d1b7
install boost in docker image and make sure cmake finds it
2021-01-27 16:37:04 -07:00
2e9db80db9
fix macOS compilation
2021-01-27 11:35:50 -07:00
75102d152a
don't use user-config on macOS and Win32
2021-01-27 10:44:19 -07:00
341069fcce
WIP asan on boost coroutine2
2021-01-26 17:10:13 -07:00
529fadbf96
Compile boost and first version of coro thread pool
2021-01-26 17:06:08 -07:00
c870903c38
fix jemalloc dependencies
2021-01-26 11:37:09 -07:00
97c5e13091
added debug message to figure out why CI is failing
2021-01-26 11:13:14 -07:00
0ef44739ea
Fix OPEN_FOR_IDE build in preparation for using clang-tidy
2021-01-26 02:04:11 +00:00
29976f0b41
Fix minor issues for aarch64
2021-01-25 12:10:57 -08:00
85e21c1ba1
CMake support for BoringSSL
2021-01-22 22:45:51 +00:00
58b4a9b907
Resolve conflicts
2021-01-21 20:59:44 +00:00
b149069b58
link statically against jemalloc
2021-01-21 13:35:27 -07:00
281151ff20
Merge remote-tracking branch 'upstream/release-6.2' into anoyes/merge-6.2-to-6.3
...
Commit conflict markers for now
2021-01-21 17:54:26 +00:00
ff7d306b09
Merge branch 'release-6.3' into anoyes/merge-6.3-to-master
...
Include conflict markers for now. Will resolve.
2021-01-15 18:04:09 +00:00
ddb5b0b050
Backport correctness package
2021-01-15 00:34:47 +00:00
e2e9b70206
Remove -Wno-unused-value
2021-01-06 22:09:38 +00:00
dae8ea24ad
Move compiler definitions into config file
2020-11-25 15:06:59 -07:00
d64cf8b9e3
Merge branch 6.3 into master
2020-11-17 11:22:45 -08:00
3b1e785e5b
Remove -Wno-unused-value for clang
2020-11-09 18:44:50 +00:00
864581c3b7
Merge remote-tracking branch 'origin/release-6.3' into features/versioned-packages
2020-11-05 15:54:39 -07:00
80d5b6c0c9
Merge pull request #4015 from xis19/release-6.3
...
Fix the CPack MacOS X package
2020-11-05 15:52:22 -07:00
703b2e276a
addressed review comments
2020-11-05 15:50:24 -07:00
7d1db8a66e
Restore building RocksDB by default with GCC
2020-11-05 09:11:58 -08:00
6b1bbc49e3
Restore building RocksDB by default with GCC
2020-11-05 17:07:53 +00:00
8ed7d296b4
Fix the ability to disable building RocksDB with GCC
2020-11-04 14:58:24 -08:00
b1194801b1
Fix the ability to disable building RocksDB with GCC
2020-11-04 21:59:14 +00:00
59fa74bfb3
FoundationDB MacOS client package > add symlink, move files
...
* In FDB 6.2, there are symlinks to backup_agent to usr/local/bin, this
patch makes 6.3 adds these symlinks to the proper positions.
* In FDB 6.2, the libfdb_c.dylib is installed to usr/local/lib, this
patch makes 6.3 install the dylib to this path.
2020-11-04 10:43:46 -08:00
bd3b6e3a48
FoundationDB MacOS server package > add data/logs path
...
The paths
./usr/local/foundationdb/logs
./usr/local/foundationdb/data
exists in 6.2 but not 6.3 for MacOS pkg server package. This patch fixes
the issue.
2020-11-04 10:43:39 -08:00
cf4c8e375f
Merge remote-tracking branch 'origin/release-6.3' into merge
2020-10-29 22:15:41 -07:00
9861d90a9d
add service files to versioned packages
...
This includes systemd and initd files. This way
an admin can manually install them in the system
2020-10-28 14:14:58 -06:00
f763d89dc3
add alternatives to install symlinks
2020-10-28 14:03:48 -06:00
ca57738df2
remove support for el6
2020-10-28 13:10:59 -06:00
b4c59e0a02
CPack refactoring and introduction of multiversion
2020-10-28 12:55:15 -06:00
e82339f40e
Merge pull request #3906 from sfc-gh-anoyes/anoyes/use-gcov
...
Add USE_GCOV cmake option
2020-10-27 08:27:46 -07:00
8e512f3109
Merge pull request #3943 from sfc-gh-anoyes/anoyes/valgrind-precise
...
Increase valgrind precision if env var FDB_VALGRIND_PRECISE is set
2020-10-26 14:01:58 -07:00
832199a089
Merge pull request #3948 from sfc-gh-mpilman/features/coverage-in-correctness
...
Features/coverage in correctness
2020-10-23 08:35:41 -07:00
2a29df0d60
Merge pull request #3949 from sfc-gh-mpilman/bugfixes/gperftools
...
Bugfixes/gperftools
2020-10-22 17:16:17 -07:00
08eaa4bc8a
Update cmake/FDBComponents.cmake
2020-10-22 17:00:59 -06:00
82fcefcb7b
add coverage files of dependencies
2020-10-22 14:51:10 -06:00
5c506908ab
Update cmake/FDBComponents.cmake
2020-10-22 14:13:24 -06:00
93d7addd28
minor fix to make gperftools integration a bit prettier
2020-10-22 13:56:05 -06:00
684171938a
set package files through an out variable
2020-10-22 13:53:03 -06:00
0906afbbf7
Add coverage file to correctness package
2020-10-22 13:49:53 -06:00
4b12b9fc01
Fix toml11 cmake
2020-10-22 13:27:06 -06:00
79163947a6
Add FLOW_KNOBS->VALGRIND_PRECISE
2020-10-22 16:31:48 +00:00
1ad779631f
Update cmake/ConfigureCompiler.cmake
2020-10-16 09:19:10 -07:00
dd23f5707f
Use add_link_options
2020-10-16 14:59:17 +00:00
52c8acf1e0
Link to how to build instrumented libc++
2020-10-15 21:37:47 +00:00
62d3b1c674
Use add_link_options. Also add USE_MSAN
...
And define the macros stacktrace.amalgamation.cpp expects
2020-10-15 17:08:41 +00:00
68de888fb4
Add USE_GCOV cmake option
...
Enabling this option adds --coverage to compilation flags and dumps
coverage data (*.gcda) files in flushAndExit. Otherwise coverage data
would not be dumped in flushAndExit. Applications that exit more
normally (e.g. returning from main) don't need special changes to dump
coverage data.
This is still experimental and we don't exactly have a plan for running
this in CI e.g., so this change just adds the option.
Tested with clang11
2020-10-15 17:08:41 +00:00
7a356d142c
Disable network test, peg doctest to version 2.4
2020-10-08 14:24:36 -07:00
2442466fc5
Remove pthread flag
2020-10-08 13:45:00 -07:00
ff5eafcf42
Swap to -pthread from -lpthread
...
This is a (probably temporary?) fix to actually fix the compilation
issue with the added unit tests when compiling with gcc. The issue seems
to be that lpthread is getting linked before another library which
requires it, so linking fails. Linking pthread instead of lpthread fixes
the issue, but this may have an effect on other binaries in the system
as well.
2020-10-02 22:52:42 -07:00
c7324761c1
pass the library path to Java tests
2020-09-25 09:38:33 -06:00
33d6c412c1
return error code correctly and cmake fixes
2020-09-24 15:58:41 -06:00
4c25214085
Add ability to run tests on fdb in ctest
2020-09-24 15:43:05 -06:00
a3c861b59d
Merge pull request #3777 from apple/release-6.3
...
Merge Release 6.3 into master
2020-09-14 10:32:50 -07:00
cfbf9dbb36
Merge remote-tracking branch 'upstream/release-6.3' into rocksdb-lz4
2020-09-09 19:20:16 +00:00
1b4aead939
Enable the RocksDB engine by default with GCC
2020-09-08 16:30:23 +00:00
d12946e569
fix autodownload path for rocksdb
2020-09-03 16:23:05 +00:00
bf5acc7296
Use lz4
2020-08-31 20:07:35 +00:00
1c96a37a77
turn off avx instruction when enable valgrind
2020-08-14 21:14:48 +00:00
fe5902994c
Merge pull request #3605 from apple/release-6.3
...
Merge Release 6.3 to master
2020-08-05 23:37:44 -07:00
c7532f3b55
Use a consistent compiler for Rocks and FDB
2020-07-29 21:41:00 +00:00
a49cb41de7
Merge branch 'release-6.3'
...
# Conflicts:
# CMakeLists.txt
# cmake/ConfigureCompiler.cmake
# fdbserver/Knobs.cpp
# fdbserver/StorageCache.actor.cpp
# fdbserver/storageserver.actor.cpp
# flow/ThreadHelper.actor.h
# flow/serialize.h
# tests/CMakeLists.txt
2020-07-29 00:31:55 -07:00
1d22a21510
Revert "temporarily disable compiler warnings"
...
This reverts commit 29142fa382
2020-07-28 17:19:52 +00:00
29142fa382
temporarily disable compiler warnings
2020-07-24 12:37:15 -07:00
d3093f50bb
attempt to get rid of compiler warnings
2020-07-24 12:24:42 -07:00
e1dedff7b3
Merge branch 'release-6.2' into release-6.3
...
# Conflicts:
# CMakeLists.txt
# bindings/c/test/mako/mako.c
# cmake/ConfigureCompiler.cmake
# documentation/sphinx/source/downloads.rst
# fdbcli/fdbcli.actor.cpp
# fdbclient/FileBackupAgent.actor.cpp
# packaging/msi/FDBInstaller.wxs
# versions.target
2020-07-24 12:10:44 -07:00
878254497a
Merge remote-tracking branch 'upstream/master' into toml-testspec
2020-07-19 22:18:31 -07:00
8ae0d9b73d
Resolve merge conflict
2020-07-13 10:21:53 -07:00
ef8c1060a2
Merge branch 'master' into mengxu/tmp-merge-6.3
2020-07-13 10:15:56 -07:00
ea48975c6e
Merge pull request #3492 from ajbeamon/merge-release-6.2-into-release-6.3
...
Merge release 6.2 into release 6.3
2020-07-13 10:02:13 -07:00
eb7ad07df0
Final cleanups.
2020-07-12 19:53:44 -07:00
0a8f61b967
Make TOML mandatory.
2020-07-12 19:43:38 -07:00
2841efe938
Rewrite most .txt tests into (pretty) .toml files.
...
This includes build/txt-to-toml.py which did the rewrites, and
can be used to rewrite other no-in-tree test spec files to toml.
I didn't touch status or restarting tests yet. Restarting will be handled
later. It turns out that I don't understand how status tests work.
2020-07-12 14:47:40 -07:00
c20fc87d6a
Fix the cmake things
2020-07-12 14:47:39 -07:00
f08f0255cc
Copy paste cmake code until it seems like it maybe downloads TOML11
2020-07-12 14:47:39 -07:00
b09dddc07e
Merge branch 'release-6.2' into merge-release-6.2-into-release-6.3
...
# Conflicts:
# cmake/ConfigureCompiler.cmake
# documentation/sphinx/source/downloads.rst
# fdbrpc/FlowTransport.actor.cpp
# fdbrpc/fdbrpc.vcxproj
# fdbserver/DataDistributionQueue.actor.cpp
# fdbserver/Knobs.cpp
# fdbserver/Knobs.h
# fdbserver/LogSystemPeekCursor.actor.cpp
# fdbserver/MasterProxyServer.actor.cpp
# fdbserver/Status.actor.cpp
# fdbserver/storageserver.actor.cpp
# flow/flow.vcxproj
2020-07-10 15:06:34 -07:00
f077d9889b
Fix osx build
2020-07-10 09:46:32 -07:00
6446b4c082
WIP
2020-07-09 22:02:43 +00:00
4ce51c4cce
Merge pull request #2768 from atn34/atn34/arena-cpp
...
Check for memory errors in arena-allocated memory
2020-07-06 09:43:28 -07:00
42159ccfe0
Add -Wpessimizing-move and -Wredundant-move for clang
2020-06-22 23:45:03 +00:00
d02bf34b32
Handle processor specific flags properly
2020-06-22 17:40:08 +00:00
970c6d02be
Fix: correctness packages included removed/future tests
2020-06-18 15:59:08 -07:00
76ac5dfeaf
Merge branch 'release-6.3' into merge-release-6.3-into-master
...
# Conflicts:
# documentation/sphinx/source/release-notes/release-notes-630.rst
2020-06-17 18:31:06 -07:00
2d1bbfd067
Fix typo
2020-06-11 14:50:48 -04:00
bb1f56fdb0
Merge branch 'rocksdb-build' of github.com:Daniel-B-Smith/foundationdb into rocksdb-build
2020-06-11 15:27:42 +00:00
eedf0cb7a6
Don't build shared RocksDB
2020-06-11 15:27:36 +00:00
1a1d45cab5
Fix ninja build
2020-06-10 22:37:03 +00:00
31db90963d
factor out duplicate include directories
2020-06-10 21:45:40 +00:00
9b3a5f8e13
Fix typo
...
Co-authored-by: Markus Pilman <markus.pilman@snowflake.com>
2020-06-10 17:34:00 -04:00
49562c2de3
Merge branch 'rocksdb-build' of github.com:Daniel-B-Smith/foundationdb into rocksdb-build
2020-06-10 21:29:39 +00:00
8c00b391da
Merge remote-tracking branch 'upstream/release-6.3' into rocksdb-build
2020-06-10 21:29:20 +00:00
dae91bb05f
Add RocksDB to FDBComponents.cmake
2020-06-10 21:07:49 +00:00
b8ac6ee41e
Get build to work with Ninja
2020-06-10 20:53:53 +00:00
Chaoguang Lin