Commit Graph

18689 Commits

Author SHA1 Message Date
Bharadwaj V.R 8cb554a006 Fix formatting issues in DDTeamCollection.actor.cpp 2022-02-23 10:21:34 -08:00
Bharadwaj V.R 102dcb30c6
Merge branch 'main' into fdb#4271 2022-02-23 10:04:19 -08:00
Jon Fu ce1d71472d Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-02-23 12:35:25 -05:00
Ata E Husain Bohra 344a14b010
Update StreamCipher ctx/cipher management to respect determinism (#6427)
* Update StreamCipher ctx/cipher management to respect determinism

StreamCipher keeps record of CipherKeys created
(including globalCipherKey) to ensure the sensitive data gets
ZERO-OUT and not recorded as part of FDB process dump. However,
in current code it is maintained as an unordered_set indexed
by the object itself. Approach adds non determinism given
object pointer based indexing scheme.

Patch addresses the concern by updating the recording to use
a map indexed by UID.
2022-02-22 17:34:29 -08:00
Renxuan Wang 3c1394578b Address comments. 2022-02-22 16:29:59 -08:00
Renxuan Wang ea8b2bd314 Resolve hostnames synchronously when calling actor is impossible. 2022-02-22 16:29:59 -08:00
Renxuan Wang 622d89b552 Rebase on main.
Since we changed ClusterConnectionString's status flag from boolean to enum in #6422, we need to update this PR correspondingly.
2022-02-22 16:29:59 -08:00
Renxuan Wang 8eb7a10404 Address comments. 2022-02-22 16:29:59 -08:00
Renxuan Wang 481587a8c6 Turn on hostname logic. 2022-02-22 16:29:59 -08:00
Trevor Clinkenbeard ab4a1d6dba
Merge pull request #6406 from sfc-gh-bvr/dd-utestclass
Dd utestclass
2022-02-22 15:18:12 -08:00
Jon Fu ae071a7211 clean up debug trace lines 2022-02-22 17:16:11 -05:00
Bharadwaj V.R f7aeae5a5c
Merge branch 'apple:main' into dd-utestclass 2022-02-22 11:59:11 -08:00
Xiaoxi Wang 341a3843b0
Merge pull request #6434 from sfc-gh-xwang/ppw-restarting
change storage_migration_mode to storage_migration_type
2022-02-22 11:32:43 -08:00
Jon Fu b60cc02aa2 fix compile error 2022-02-22 13:10:30 -05:00
Jon Fu 2e2c8bf88c Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-02-22 12:43:55 -05:00
Jon Fu 31d56b2f50 adjust knob setting, revert trace changes, and disable cache if onError retries transactions 2022-02-22 12:42:53 -05:00
Xiaoxi Wang 59ac1dffb4 change storage_migration_mode to storage_migration_type 2022-02-22 09:36:30 -08:00
Renxuan Wang c29c522d3e Change ClusterConnectionString's status flag from boolean to enum.
So that when multiple threads try to resolve hostnames concurrently, we should have only one resolving and others wait on the result. Otherwise, they would add duplicated resolved results to coordinators.
2022-02-21 10:53:03 -08:00
pluveto 6d101732e1 Fix invalid link to download page
Not available: https://www.foundationdb.org/download/
Change to https://github.com/apple/foundationdb/releases
2022-02-21 09:30:15 -08:00
Mohamed Oulmahdi b021ff6083
Merge pull request #6416 from Doxense/fix-purge-outdated-history
Fix `purgeOutdatedHistory`
2022-02-19 10:00:59 +01:00
Trevor Clinkenbeard 82bbfa8aee
Merge pull request #6395 from sfc-gh-tclinkenbeard/global-tag-throttling
Create `TagThrottler` class
2022-02-18 13:17:28 -08:00
vikasgupta8 7c71821666 Updated cmake process string to match with ppc64le or powerpc64le 2022-02-18 12:53:23 +00:00
Mohamed Oulmahdi d32d18ea64 Fix purgeOutdatedHistory 2022-02-18 11:47:44 +01:00
vikasgupta8 7bd767f198 Updated cmake process string to match with ppc64le or powerpc64le 2022-02-18 09:35:45 +00:00
Bharadwaj V.R c1b0b336ce Fix merge conflicts in DDTC.actor.cpp - change serverMetrics to setServerMetrics and setTeamHealthy to markTeamUnhealthy 2022-02-17 20:41:38 -08:00
Bharadwaj V.R 49d2a56776
Merge branch 'main' into dd-utestclass 2022-02-17 20:22:07 -08:00
Xiaoxi Wang 4dffb61f78
Merge pull request #6403 from sfc-gh-xwang/ppw-restarting
move perpetual wiggle upgrade & downgrade test to 7.1
2022-02-17 15:57:24 -08:00
Trevor Clinkenbeard 1368a4e2c4
Merge pull request #6407 from sfc-gh-tclinkenbeard/fix-knob-default
Increase `ITERATIONS_PER_REACTOR_CHECK` default
2022-02-17 15:02:17 -08:00
sfc-gh-tclinkenbeard d01f035848 Increase ITERATIONS_PER_REACTOR_CHECK default 2022-02-17 13:45:17 -08:00
Bharadwaj V.R c568f9884d Make a few more DDCollection methods private 2022-02-17 08:25:20 -08:00
Bharadwaj V.R a54acb3720 Temporarily lower safety buffer knob. AtomicBackupCorrectness needs fixing 2022-02-16 19:26:40 -08:00
Bharadwaj V.R 7a17dbeacc Create DD unit test class. Start to make test-specific methods in DDTeamCollection private 2022-02-16 19:18:24 -08:00
Xiaoxi Wang f2b59af9b0 format code 2022-02-16 16:32:06 -08:00
Bharadwaj V.R 27855bc5b5
Merge branch 'apple:main' into fdb#4271 2022-02-16 15:38:36 -08:00
Zhe Wu e07ae6fdb9 Address comments 2022-02-16 15:28:56 -08:00
Zhe Wu 9da735c38e Batch empty peek reply 2022-02-16 15:28:56 -08:00
Jon Fu e0d3b0a488 format times in trace event 2022-02-16 16:55:14 -05:00
Jon Fu 6199faadc3 fix bug which constantly overwrote start time of last throttled queue 2022-02-16 16:52:38 -05:00
Jon Fu 5846dda410 temporary changes and extra traces for debugging 2022-02-16 15:05:25 -05:00
Xiaoxi Wang e3909ad05e modify test file 2022-02-16 11:54:31 -08:00
Bharadwaj V.R 949f1f1c3e Switch to testing MIN_AVAILABLE_SPACE 2022-02-16 11:33:07 -08:00
Xiaoxi Wang 3dfdc6943c move downgrade/upgrade test to XXX_7.1.0 because in 7.0 the workload doesn't have the fix 2022-02-16 10:48:31 -08:00
Bharadwaj V.R 3fe6a952f1 Merge with upstream tcinfo refactor and move the server knob init to be adjacent to related knobs 2022-02-16 10:28:55 -08:00
Bharadwaj V.R cb5f44c76d
Merge branch 'apple:main' into fdb#4271 2022-02-16 10:14:50 -08:00
Trevor Clinkenbeard 3da99fa55a
Merge pull request #6390 from sfc-gh-tclinkenbeard/dd-refactor
Improve encapsulation of `TCServerInfo`
2022-02-16 10:06:45 -08:00
Bharadwaj V.R fe03e6f822 Introduce a new server knob and use it to test if storage servers are near the min bar for available space 2022-02-15 22:43:06 -08:00
Trevor Clinkenbeard 57f59a66f4
Merge pull request #6252 from sfc-gh-tclinkenbeard/flow-enhancements
Add Flow benchmarks and `ITERATIONS_PER_REACTOR_CHECK` knob
2022-02-15 18:50:48 -08:00
sfc-gh-tclinkenbeard a32547cbbe Merge remote-tracking branch 'origin/main' into flow-enhancements 2022-02-15 15:56:42 -08:00
sfc-gh-tclinkenbeard 32bbabefd7 Merge remote-tracking branch 'origin/main' into dd-refactor 2022-02-15 14:11:30 -08:00
Jon Fu d399daebed Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-02-15 15:09:40 -05:00