Commit Graph

21167 Commits

Author SHA1 Message Date
A.J. Beamon 91949439d2 Add support for returning whether a key-backed type range read has more results or not. 2022-07-13 15:46:10 -07:00
Josh Slocum b85fbaef52
Merge pull request #7395 from sfc-gh-jslocum/bg_file_chunking
Chunked Snapshot Files
2022-07-13 17:22:34 -05:00
Josh Slocum e32e726b9f
Merge pull request #7583 from sfc-gh-jslocum/granule_merging_improvements
Granule merging improvements
2022-07-13 16:04:22 -05:00
Xiaoxi Wang a2062df220
Merge pull request #7573 from sfc-gh-xwang/feature/dd-refactor-incremental
move getInitialDataDistribution to DDTxnProcessor
2022-07-13 10:00:38 -07:00
Xiaoxi Wang e0984091f3
Merge pull request #7494 from sfc-gh-xwang/bug/cycle-issue7423
Extend transaction window in Cycle workload if in simulation the transaction_too_old keep appearing
2022-07-13 09:25:16 -07:00
Josh Slocum b9437e9a8d BW re-sending merge candidate if manager changes 2022-07-13 10:39:55 -05:00
Josh Slocum 0720b358ff comments and bug fix 2022-07-13 08:01:26 -05:00
Josh Slocum b2a96b64e6 refactoring one function into two 2022-07-13 07:49:19 -05:00
Josh Slocum 03c39dc33b
Merge pull request #7579 from sfc-gh-jslocum/granule_merging
Granule merging
2022-07-13 07:25:26 -05:00
Yao Xiao e367a5a160
Add KVS physical shard metrics. (#7581) 2022-07-13 01:31:05 -07:00
Xiaoxi Wang a9e9772b98 fix argument bug 2022-07-12 16:49:09 -07:00
Josh Slocum f707626213 Cleanup 2022-07-12 17:43:44 -05:00
Xiaoxi Wang d3686143a1 merge upstream/main 2022-07-12 14:28:49 -07:00
Josh Slocum 236630855b Merge branch 'main' into granule_merging 2022-07-12 15:24:26 -05:00
Xiaoxi Wang a4929f3f6f
Merge pull request #7576 from sfc-gh-xwang/feature/dd-refactor-simple
[DD Testability] move waitDataDistributorEnabled to txnProcessor
2022-07-12 13:23:29 -07:00
A.J. Beamon 029ef3c857
Merge pull request #7571 from sfc-gh-ajbeamon/fdbcli-parse-integer-options
Parse integer options in fdbcli rather than passing the bytes unparsed
2022-07-12 13:08:46 -07:00
Xiaoxi Wang bf98dc2a2b move waitDataDistributorEnabled to txnProcessor 2022-07-12 11:25:59 -07:00
Yi Wu 7d8131a39c
Worker register with cluster controller before disk file recovery (#7510)
Previously worker servers only register with cluster controller after local file recovery. This PR change to let worker servers register itself before local file recovery, but indicate that although it can server stateless roles, it cannot become storage or TLog server. After local file recovery, the worker will register again to indicate it can now become storage and Tlog.

The change fixes the deadlock issue with encryption, where when there's only stateful workers that can become master and EKP, those worker servers won't be able to register with cluster controller since no EKP is available to provide cipher keys to decrypt encrypted storage.

For now we have the change only when encryption is on, and will make it the default behavior once we think it is stable.
2022-07-12 10:19:32 -07:00
Xiaoxi Wang 110f3bbde9 remove reset speedUpSimulation 2022-07-12 09:13:33 -07:00
Xiaoxi Wang 878adad43f reset some changes 2022-07-12 09:13:33 -07:00
Xiaoxi Wang 5e8f55768a use speedUp to extend transaction window 2022-07-12 09:13:32 -07:00
Xiaoxi Wang b4b4a4a2f9 an failed fix 2022-07-12 09:13:32 -07:00
Xiaoxi Wang 55aed68a45 detach debug commit 2022-07-12 09:13:32 -07:00
Josh Slocum 0b0ac16a4c Merge branch 'main' into granule_merging 2022-07-12 09:09:30 -05:00
Josh Slocum c6700fe62f Merge branch 'main' into bg_file_chunking 2022-07-12 08:28:06 -05:00
Xiaoxi Wang 7e067ee4de move getInitialDataDistribution to DDTxnProcessor 2022-07-11 21:54:47 -07:00
Xiaoxi Wang cc185c51c6
Merge pull request #7563 from sfc-gh-xwang/feature/dd-refactor-incremental
[DD Testability] move updateReplicaKey to txnProcessor
2022-07-11 17:11:55 -07:00
A.J. Beamon a3f970cf3a Parse integer options in fdbcli rather than passing the bytes unparsed. This allows specifing the string "1" instead of "\x01\x00\x00\x00\x00\x00\x00\x00". 2022-07-11 16:39:59 -07:00
Markus Pilman fa9e623fc1
Merge pull request #7459 from sfc-gh-ljoswiak/features/module-link-tests
Add test executables to catch missing symbols in modules
2022-07-11 17:31:11 -06:00
Markus Pilman 4f4095b6ae
Merge pull request #7385 from sfc-gh-etschannen/fix-multiple-shared-tlogs
Avoid recruiting multiple shared tlogs
2022-07-11 17:28:35 -06:00
Markus Pilman 4ece33a0a8
Merge pull request #7445 from sfc-gh-anoyes/anoyes/fix-ubsan
Fix UBSAN build when statically linking libcxx
2022-07-11 17:27:37 -06:00
Jingyu Zhou 474a9ab124
Merge pull request #7567 from sfc-gh-fzhao/DuplicateHedaerFiles
Redwood remove duplicate header files
2022-07-11 13:59:39 -07:00
Jingyu Zhou e9d62c0456
Merge pull request #7561 from jzhou77/main
Add 7.1.14 and 7.1.15 release notes
2022-07-11 13:53:32 -07:00
Jingyu Zhou ad8c5e282e
Merge pull request #7520 from johscheuer/operator-docs-unified
Add docs for how to run the operator with the unified image
2022-07-11 13:36:20 -07:00
Jingyu Zhou 58aa5a9e1d
Merge pull request #7539 from sfc-gh-fzhao/SetFetchKey
set isFetchKeys for getRangeStreamFragment
2022-07-11 13:25:24 -07:00
Fuheng Zhao 3aeb2f17cd Redwood remove duplicate header files 2022-07-11 12:44:44 -07:00
Josh Slocum 094999439d Fixing another change feed fetch race by making refreshing idempotent 2022-07-11 14:25:01 -05:00
Xiaoxi Wang f42b8687c2 add comment 2022-07-11 11:26:46 -07:00
Xiaoxi Wang 447eaa1d81 move updateReplicaKey to txnProcessor 2022-07-11 11:16:17 -07:00
Jingyu Zhou ef37bf3fca Add 7.1.14 and 7.1.15 release notes 2022-07-11 10:29:38 -07:00
Dan Lambright 96bd3dcbf0
custom loopback cluster script (#7550) 2022-07-11 13:02:37 -04:00
Vaidas Gasiunas 0a2e5c830c
C shim library build clean up (#7560)
* Remove unnecessary Implib.so files

* Improve cmake dependencies on doctest
2022-07-11 17:57:28 +02:00
Jingyu Zhou 347339426b
Merge pull request #7552 from jleach4/7543
Changing hasIncompleteVersionstamp to use iteration rather than stream processing #7543
2022-07-08 21:19:14 -07:00
Chaoguang Lin 901d988de9
Add a knob SNAPSHOT_ALL_STATEFUL_PROCESSES to snapshot all processes with stateful class type(storage, log, transaction) even if they are not recruited (#7554) 2022-07-08 20:53:49 -07:00
Xiaoxi Wang 68f3d463e2
Merge pull request #7557 from sfc-gh-xwang/feature/dd-refactor-incremental
[DD Testability] move getDatabaseConfiguration to txnProcessor
2022-07-08 20:22:27 -07:00
Xiaoxi Wang 5ce1d7342d Merge branch 'feature/dd-refactor-incremental' of https://github.com/sfc-gh-xwang/foundationdb into feature/dd-refactor-incremental 2022-07-08 16:35:31 -07:00
Xiaoxi Wang 9fe76ecf21 format 2022-07-08 16:34:55 -07:00
Xiaoxi Wang a941a28de7
Merge branch 'apple:main' into feature/dd-refactor-incremental 2022-07-08 16:07:16 -07:00
Xiaoxi Wang b48b1e93f9 remove header dependency; move getDatabaseConfiguration to txnProcessor 2022-07-08 16:01:23 -07:00
Xiaoxi Wang 6be20d08ae
Merge pull request #7555 from sfc-gh-xwang/feature/dd-refactor-incremental
[DD Testability] move takeMoveKeysLock to DDTxnProcessor
2022-07-08 15:40:14 -07:00