Commit Graph

25680 Commits

Author SHA1 Message Date
Xiaoxi Wang d8739c1b8b Merge branch 'main' of https://github.com/apple/foundationdb into fix/main/killall 2023-03-03 09:56:00 -08:00
Nim Wijetunga 57ff58fd1a
EKP Retry Loop on KMS Connection Failures (#9524)
EKP Retry Loop
2023-03-03 09:41:20 -08:00
Jingyu Zhou b08291e8e2 Add more trace events 2023-03-03 09:40:44 -08:00
Xiaoxi Wang b13b586b71
Merge pull request #9547 from sfc-gh-xwang/feature/main/minReadBand
add knob for min read rebalance shard bandwidth
2023-03-03 09:37:23 -08:00
Jingyu Zhou ee5154f478 Refactor decoder to read file as a whole once
To reduce the number of network requests.
2023-03-03 09:32:12 -08:00
Jingyu Zhou f235ae33e8
Merge pull request #9562 from sfc-gh-vgasiunas/vgasiunas-fix-symbolify
Fix exported symbol extraction in Apple builds
2023-03-03 09:12:52 -08:00
Zhe Wang 31de01b1e0 fmt 2023-03-03 09:06:10 -08:00
Zhe Wang 1766f412bb address comments 2023-03-03 09:04:26 -08:00
Zhe Wang 999cf37ab0 clean 2023-03-03 09:04:26 -08:00
Zhe Wang 6d4fc8d486 clean 2023-03-03 09:04:26 -08:00
Zhe Wang 91d5521e72 clean 2023-03-03 09:04:26 -08:00
Zhe Wang e8aced0961 add sampled sample bytes to sst file 2023-03-03 09:04:26 -08:00
Zhe Wang 7e37d4a8a7 trace events added 2023-03-03 09:04:26 -08:00
Zhe Wang ab2dbd873b cleanup 2023-03-03 09:04:26 -08:00
Zhe Wang 83a0547281 address comments and add test 2023-03-03 09:04:26 -08:00
Zhe Wang d8c1b18252 revise range check 2023-03-03 09:04:26 -08:00
Zhe Wang 338e0971a9 address comments 2023-03-03 09:04:25 -08:00
Zhe Wang c677f4c705 tiny fix 2023-03-03 09:04:25 -08:00
Zhe Wang 43cce3cc58 clean and address comment 2023-03-03 09:04:25 -08:00
Zhe Wang e283e067d3 clean and address comments 2023-03-03 09:04:25 -08:00
Zhe Wang b5639339ad address comments 2023-03-03 09:04:25 -08:00
Zhe Wang 6c42062018 address comments 2023-03-03 09:04:25 -08:00
Zhe Wang 2e68b44579 dump-checkpoint-meta-data-to-sstfile 2023-03-03 09:04:25 -08:00
Josh Slocum baf85d7dfe also send recruitment_failed back to BM for other initialization errors like storage engine initialization 2023-03-03 10:02:11 -06:00
Vaidas Gasiunas a0e1b4b369 Fixing exported symbols extraction from C headers for Apple build 2023-03-03 14:04:35 +01:00
Vaidas Gasiunas e95ff58b95 Reformat symbolify.py 2023-03-03 14:00:59 +01:00
Steve Atherton b0d595c7d7 Merge commit '3d9f37d1d12f95d52ef2f6bf57f123fdf6101602' into redwood-queue-error-handling 2023-03-03 01:09:04 -08:00
Steve Atherton 8b6efcca82 Added error forwarding to background actors in Redwood to surface errors sooner. This doesn't fix any known failures but it would avoid some broken_promise errors being seen before IO errors, which isn't incorrect just unclear. 2023-03-02 21:54:56 -08:00
Zhe Wang 0b6fa91056 fix dd storage audit race between serving request and resumption 2023-03-02 21:47:06 -08:00
Steve Atherton b2d3b35774 Add option to FlowMutex to wait forever if there is an error and use this in Redwood's pager queue cursor. This avoids a broken_promise error being seen before shutdown after a queue read sees an IO error or timeout. 2023-03-02 16:41:45 -08:00
Josh Slocum 762e86de97 another fix and changing the timeout back 2023-03-02 17:14:17 -06:00
Josh Slocum c6a21245d8 also using other GRVs BW already gets for committed version checking 2023-03-02 17:14:17 -06:00
Josh Slocum 57b120e702 Adding grv history so delta files can wait for less time to determine that they're committed 2023-03-02 17:14:17 -06:00
Xiaoxi Wang 06be89d714 Merge branch 'main' of https://github.com/apple/foundationdb into fix/main/killall 2023-03-02 11:54:07 -08:00
Jingyu Zhou 3d9f37d1d1
Merge pull request #9530 from sfc-gh-jslocum/more_bg_correctness_fixes
More bg correctness fixes
2023-03-02 11:29:01 -08:00
Xiaoxi Wang 26ffcf6b4a add knob for min read rebalance shard bandwidth 2023-03-02 11:26:27 -08:00
Xiaoxi Wang 2dcacea7e1
Merge pull request #9517 from sfc-gh-xwang/feature/main/hotRangeDetect
Hot range detection improvement
2023-03-02 11:19:48 -08:00
Xiaoxi Wang 010d5590e3 Merge branch 'main' of https://github.com/apple/foundationdb into feature/main/hotRangeDetect 2023-03-02 10:07:17 -08:00
Jingyu Zhou de89d2cca1
Merge pull request #9521 from sfc-gh-ajbeamon/fix-metacluster-issues
Fix some metacluster issues
2023-03-02 10:07:11 -08:00
Jingyu Zhou ad1468a7b9
Merge pull request #9515 from sfc-gh-ajbeamon/transaction-debug-logging
Add the ability to attach debug printing or tracing to transactions
2023-03-02 10:06:24 -08:00
Jingyu Zhou 0dd948d41b
Merge pull request #9523 from sfc-gh-ajbeamon/transaction-not-found-for-conflicted-transactions
Check transaction validity with respect to tenants even if it will fail with a conflict
2023-03-02 10:03:09 -08:00
Jingyu Zhou ad778cbe5e Merge branch 'main' of https://github.com/apple/foundationdb into fix 2023-03-02 09:56:30 -08:00
Josh Slocum 0c9397ef22 BW metric improvements for reads and file blocking 2023-03-02 10:57:51 -06:00
A.J. Beamon 557b778053 Merge branch 'main' into transaction-not-found-for-conflicted-transactions 2023-03-02 08:46:33 -08:00
A.J. Beamon 9abca2b3de Merge branch 'main' into fix-metacluster-issues 2023-03-02 08:45:15 -08:00
A.J. Beamon d7fe58b0ca Merge branch 'main' into transaction-debug-logging 2023-03-02 08:37:26 -08:00
Josh Slocum c0c840caf1 increasing small granule size in local tests 2023-03-02 09:37:40 -06:00
Josh Slocum 3861a2249b increasing bw request timeout 2023-03-02 09:36:47 -06:00
Josh Slocum 40ed365303 fixing checkBlobSubRange to not increase version every retry 2023-03-02 09:34:55 -06:00
Josh Slocum fdcb6aed5f add timestamp to bg verbose tester logs 2023-03-02 09:34:40 -06:00