Commit Graph

156 Commits

Author SHA1 Message Date
Josh Slocum c8c97e0256 Blob Worker focused cleanup 2022-03-10 09:55:23 -06:00
Josh Slocum 1f964ac085 BM focused cleanup 2022-03-09 15:04:17 -06:00
Josh Slocum 9dbb6d216e SS-focused cleanup 2022-03-09 10:39:04 -06:00
Josh Slocum b21d0943b9 client-focused cleanup 2022-03-09 10:01:25 -06:00
Josh Slocum f230ac0e41 Fixing more merge issues 2022-03-09 09:13:03 -06:00
Josh Slocum e71b3533f9 Merge branch 'main' into blob_integration 2022-03-09 08:59:56 -06:00
Jingyu Zhou 1a5bf25b5c Update code base to use fmt 8.1.1 2022-03-04 15:52:06 -08:00
Josh Slocum e0578f24d2 Fixes for range streaming BG snapshot 2022-03-01 12:45:58 -06:00
Evan Tschannen 6f1fb71949 Fixed a number of different pruning problems 2022-03-01 10:13:20 -08:00
Evan Tschannen 8f8987ad67 Merge branch 'blob_integration' of https://github.com/apple/foundationdb into blob_integration 2022-03-01 10:12:36 -08:00
Josh Slocum 06f58f848d Improving change feed validation, and another popped while reading race fixed 2022-03-01 12:05:55 -06:00
Josh Slocum c27204d401 more BM split race fixes 2022-03-01 07:18:43 -06:00
Josh Slocum 839edbf5ea moved granule split evaluation to not be specific to any individual blob worker, to simplify it and handle additional cases 2022-02-28 16:49:58 -06:00
Josh Slocum 642aab2b8b blob manager range assignment race fixes 2022-02-28 16:12:27 -06:00
Josh Slocum a556582041 Fixes for new BM reecovery 2022-02-28 10:36:28 -06:00
Josh Slocum 921be1dedf fixed revoking when same worker has granule 2022-02-28 08:44:12 -06:00
Josh Slocum ed9f95b299 simplifying blob manager recovery by always treating the DB granule mapping as the source of truth, and persisting all boundary changes there BEFORE updating workers 2022-02-25 14:46:14 -06:00
Evan Tschannen 940f26cb0c Merge branch 'blob_integration' of https://github.com/apple/foundationdb into blob_integration 2022-02-25 11:00:13 -08:00
Josh Slocum bc7cc984b0 Fixing BGVerifyBalance test killing issues 2022-02-25 11:30:21 -06:00
A.J. Beamon 250a88e682 Enforce that trace event suppression calls happen first when using trace event call chaining. Fix various instances where we weren't following this requirement. 2022-02-24 12:25:52 -08:00
Josh Slocum 0714b7a250 Fixed blob manager split and reassign race 2022-02-23 08:48:45 -06:00
Evan Tschannen 330b2b48ec improved file cleanup execution and testing 2022-02-22 12:00:09 -08:00
Josh Slocum 38a75a8b89 Merge branch 'main' into blob_integration 2022-02-17 17:47:38 -06:00
Josh Slocum 662618a5bc Blob Manager lock fixes 2022-02-17 10:01:20 -06:00
Josh Slocum 031a11116b Fixing race between range mover and range split reassign 2022-02-10 11:50:51 -06:00
Josh Slocum 9277296102 Set doneRecovering for first blob manager 2022-02-08 17:47:08 -06:00
Josh Slocum f05a589669 Fixing blob manager recovery/blob worker status stream races 2022-02-08 17:17:32 -06:00
Josh Slocum 9aaee145b2 Fixing range assignment bug 2022-02-07 17:48:56 -06:00
Josh Slocum 41a274ed9c Fixing bug and refactoring iterative range splitting 2022-02-04 17:10:46 -06:00
Josh Slocum c1559e6392 more blob manager recovery issues 2022-02-03 18:14:54 -06:00
Josh Slocum feccea05e5 Fixing incorrect revokes on blob manager recovery 2022-02-03 06:15:22 -06:00
Josh Slocum f16142e639 Fixed memory lifetime issue in blob manager recovery 2022-02-02 15:57:32 -06:00
Josh Slocum d58b0325b3 Added write-hot granule splitting and splitting based on write rate 2022-02-02 09:45:18 -06:00
Josh Slocum 25f291cf6d Improving blob manager recovery of client blob ranges 2022-02-01 14:38:54 -06:00
Josh Slocum 45f4235f2b Fixing worker dying in BM recovery race 2022-01-31 20:59:58 -06:00
Josh Slocum d46ef148bb Fixing granule revoke on recover 2022-01-31 19:59:41 -06:00
Josh Slocum 30d8c593c8 Fix for new manager recovery 2022-01-31 19:59:41 -06:00
Josh Slocum d0113a6776 Added mechanism for blob manager to poll blob workers for their granule assignments, and used that to improve manager recovery 2022-01-31 19:59:41 -06:00
Josh Slocum 05f27eac50 range mover fix 2022-01-31 08:27:37 -06:00
Josh Slocum bf6ed8348f A couple workload improvements 2022-01-27 10:26:35 -06:00
Josh Slocum 74c8167745 Not using krm for blob manager worker mapping recovery 2022-01-27 10:26:35 -06:00
Josh Slocum 826f956990 Fixed manager recovery order of in progress splits 2022-01-26 08:38:24 -06:00
Josh Slocum 14cc0a8b02 Got BlobGranuleCorrectnessWorkload passing a single test 2022-01-25 15:46:29 -06:00
Josh Slocum 1494f8216b Reworked blob manager recovery to be more efficient and handle overlapping ongoing splits 2022-01-24 14:12:45 -06:00
Josh Slocum 42a36dc756 Fixed Blob Manager recruitment error and Blob Worker monitoring error 2022-01-24 09:46:37 -06:00
Josh Slocum 9ccffe911b Added exponential backoff for re-establishing blob worker monitoring 2022-01-21 14:21:00 -06:00
Josh Slocum 269dfb79cf Fixes to checkBlobWorkerList 2022-01-21 10:29:54 -06:00
Josh Slocum be98fc9a58 Fixed incorrect assert in blob manager 2022-01-21 08:28:36 -06:00
Josh Slocum a8f1d6fa00 StorageMetrics and and halting fixes 2022-01-20 19:27:25 -06:00
Josh Slocum a7a6e0ee9c More blob worker failure fixes 2022-01-20 19:27:25 -06:00