Commit Graph

9602 Commits

Author SHA1 Message Date
Evan Tschannen a3598a7616
Merge pull request #2738 from ajbeamon/fix-assertion-failure-on-io-error
Fix assertion failure in SQLite thread pools on io_error
2020-04-14 16:48:22 -07:00
Evan Tschannen dd951afe92
Merge pull request #2735 from ajbeamon/grv-proxy-perf-improvements
Improve proxy GRV latencies and responsiveness
2020-04-14 16:45:48 -07:00
Evan Tschannen e710444c06
Merge pull request #2608 from ajbeamon/run-loop-busy-profiler
Add run loop profiling when the run loop is saturated
2020-04-14 16:36:05 -07:00
Meng Xu 08c8fac2af
Merge pull request #2943 from jzhou77/backup-fix
Buggify master recruit backup worker delay
2020-04-14 16:20:28 -07:00
A.J. Beamon 541c81a92a Fix merge related issue. 2020-04-14 14:10:12 -07:00
A.J. Beamon e104a2e3a6 Merge commit 'cf01233f28a2c42908656a39f458a4475c1d44a3' into run-loop-busy-profiler
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	fdbclient/NativeAPI.actor.h
#	fdbserver/fdbserver.actor.cpp
#	flow/Net2.actor.cpp
2020-04-14 14:02:24 -07:00
A.J. Beamon 9d6f2352d9 Merge commit 'cf01233f28a2c42908656a39f458a4475c1d44a3' into grv-proxy-perf-improvements
# Conflicts:
#	fdbserver/Knobs.cpp
#	fdbserver/Knobs.h
#	fdbserver/MasterProxyServer.actor.cpp
2020-04-14 13:49:09 -07:00
Evan Tschannen cf01233f28
Merge pull request #2549 from ajbeamon/slow-task-and-priority-tracking-improvements
Slow task and priority tracker improvements
2020-04-14 13:26:32 -07:00
Alvin Moore 6bafd7477f
Merge pull request #2949 from AlvinMooreSr/fdb-java-tests
Create Java Tests Package
2020-04-14 11:42:26 -07:00
Alvin Moore c8e17f0b2b
Merge pull request #2934 from mpilman/features/llvm10
Several CMake fixes
2020-04-14 01:42:31 -07:00
Alex Miller 2e53c8c5e2
Merge pull request #2915 from tclinken/move-optimizations
Avoid unnecessary copies in PromiseStream
2020-04-13 21:15:16 -07:00
mpilman 7aa030a850 fix weird typo 2020-04-13 21:08:48 -07:00
mpilman f0ab168368 attempt on fixing make bug 2020-04-13 20:34:09 -07:00
mpilman c6a224d221 Merge branch 'master' of https://github.com/apple/foundationdb into features/llvm10 2020-04-13 20:25:09 -07:00
mpilman e6952d3fb7 Merge remote-tracking branch 'upstream/master' into features/llvm10 2020-04-13 20:21:23 -07:00
Meng Xu de9ab9ddde
Merge pull request #2913 from alexmiller-apple/reduce-txn-state-store-size
Replace UID with Tag in keyServers to reduce transaction state store size
2020-04-13 20:19:44 -07:00
mpilman e493ced88f removed unused variable 2020-04-13 20:06:33 -07:00
Alvin Moore 54813e2d46 Added support for copying fdb java tests to package directory 2020-04-13 17:20:25 -07:00
A.J. Beamon c851ee4031
Merge pull request #2897 from tclinken/fix-trace-batch-loggroup-and-role
Annotate trace batch events before dumping
2020-04-13 11:22:51 -07:00
Meng Xu a9cd8fe303
Merge pull request #2945 from alexmiller-apple/tlog-forward-compatibility-doc
Add design doc for TLog forward compatibility
2020-04-12 22:14:22 -07:00
Alex Miller c8ab69cce6 Fix incorrect if/ASSERT logic from last minute cleanups.
My test code serialized UIDs and Tags, so that I could compare and
verify I got the same thing, and I undid this right before committing,
but forgot to also change the `if` to not rely on UIDs being first also.
2020-04-12 19:38:51 -07:00
Alex Miller 1439de37b5 Convert GetRangeLimits() -> TOO_MANY + ASSERT(). 2020-04-12 18:23:14 -07:00
Alex Miller db071256db Merge remote-tracking branch 'upstream/master' into reduce-txn-state-store-size 2020-04-12 18:06:10 -07:00
Alex Miller befcfcd395 Add design doc for TLog forward compatibility. 2020-04-12 17:51:21 -07:00
Alex Miller cf81e34d5a
Merge pull request #2906 from satherton/keyvaluestorememory-delta-compression
Added key delta compression to KeyValueStoreMemory on-disk state.
2020-04-12 17:36:24 -07:00
Jingyu Zhou 3be131af76
Merge pull request #2944 from xumengpanda/mengxu/fr-send-mutations-batch-PR
Performant restore [28/xx]: Improve bandwidth of sending mutations from loaders to appliers
2020-04-12 16:54:33 -07:00
Meng Xu dbc9c23193 FastRestore:Loader:Send mutations at different versions in the same message to appliers
This increases the bandwidth sent from loaders to appliers.
2020-04-12 10:46:58 -07:00
Meng Xu a272bf4e66
Merge pull request #2931 from jzhou77/backup-progress
Consolidate backup container APIs
2020-04-11 22:47:20 -07:00
Jingyu Zhou 87b8aae3e5 Buggify master recruit backup worker delay 2020-04-11 22:37:04 -07:00
Meng Xu 55ee034e7f
Merge pull request #2916 from jzhou77/backup-fix
Remove version stamp ops from RestoreApplier
2020-04-11 14:04:11 -07:00
Jingyu Zhou 4e128328f7 Stop backup workers before clearing DB in parallel restore workload
This is because the clearing of DB can be picked up by backup workers and be
applied during restore, causing restore failures.
2020-04-11 10:26:08 -07:00
Jingyu Zhou 7e5551ea19 Avoid overlapping version ranges for backup workers
Sometimes, an epoch's begin version is lower than the previous epoch's end
version. In some rare casse, the master ends up recruiting backup workers for
both epoch and have overlapping ranges of [epochBeginVersion, prevEpochEndVersion].
Since the popping order is by epoch. Previous epoch can pop the mutation and
save to a log file. Then this epoch will miss these popped mutation in the
overlapping range, causing corrupted mutation logs.
2020-04-10 21:19:37 -07:00
Markus Pilman e004d912bd Also depend on Joshua scripts 2020-04-10 18:23:29 -07:00
Markus Pilman 4b5fdef976 fix correctness dependencies 2020-04-10 18:16:52 -07:00
Xin Dong 77f01193cb
Merge pull request #2938 from xumengpanda/mengxu/DD-knob-test-PR
Test the knob DESIRED_TEAMS_PER_SERVER between 1 and 10
2020-04-10 16:52:43 -07:00
Meng Xu 221235719a
Merge pull request #2939 from xumengpanda/mengxu/rm-snap-PR
Exclude Snap related tests from correctness test temporily
2020-04-10 14:10:33 -07:00
A.J. Beamon bcb0a4cc78
Merge pull request #2890 from tclinken/expose-lock-fdbcli
Add lock and unlock commands to fdbcli
2020-04-10 13:54:47 -07:00
tclinken 8ef5a04896 Guard all of annotateEvent with mutex 2020-04-10 13:03:15 -07:00
Markus Pilman 945832a0bb remove llvm from docker image 2020-04-10 10:38:24 -07:00
Markus Pilman a3b5efe6eb suppress weird ccache warning with clang 2020-04-10 10:08:24 -07:00
Markus Pilman 4d64beeba3 add clangd to ~/bin 2020-04-10 10:07:58 -07:00
Meng Xu f95bbc0ffa Exclude Snap related tests from correctness test temporily
Those tests fail with high chance in nightly test.
2020-04-10 10:01:07 -07:00
Meng Xu fe4bf3092f Buggify DESIRED_TEAMS_PER_SERVER between 1 and 10 2020-04-10 09:43:01 -07:00
Markus Pilman 5a64dab74f fix linker error 2020-04-09 14:27:13 -07:00
Markus Pilman 20a2fe2785 Add LLVM to docker file 2020-04-09 14:20:52 -07:00
Markus Pilman ceab4374cf statically link libc++ 2020-04-09 14:16:14 -07:00
Markus Pilman 0e7592c757 don't fail docker script if group already exists 2020-04-09 14:15:58 -07:00
tclinken 01285f3374 Delay annotation of trace batch events created before trace file is opened 2020-04-09 14:09:00 -07:00
Jingyu Zhou db2cef844b Write mutation log type as a backup property
This can solve the problem when listing log files returns empty results.
2020-04-09 09:29:24 -07:00
Jingyu Zhou 4d06e837dc Remove getPartitionedRestoreSet() API
Use getRestoreSet() instead for both old and new partitioned logs.
2020-04-08 20:12:09 -07:00