Commit Graph

18139 Commits

Author SHA1 Message Date
Suraj Gupta 63b7666f49 Some more small fixes for compilation 2021-12-10 16:43:58 -06:00
Suraj Gupta 23de6fa39b Get it compiled 2021-12-10 16:43:58 -06:00
Suraj Gupta 3fe7a9f553 More fixes 2021-12-10 16:43:58 -06:00
Suraj Gupta 932f68e1b3 Refactor bstore and add watch key. 2021-12-10 16:43:58 -06:00
Suraj Gupta 22d72ec9dd init 2021-12-10 16:43:58 -06:00
Suraj Gupta f68c1fd3c4 Use _sr and fix disabling case. 2021-12-10 14:00:34 -06:00
Suraj Gupta c89fd0c3a8 reset txn after getting 2021-12-10 14:00:34 -06:00
Suraj Gupta 968a4f9f50 Don't rely on database config to be updated. 2021-12-10 14:00:34 -06:00
Suraj Gupta 6765d3dff7 Default to blob granules disabled. 2021-12-10 14:00:34 -06:00
Suraj Gupta 640cee2072 Start BM without config change if config is enabled. 2021-12-10 14:00:34 -06:00
Suraj Gupta d3fbad74a2 cleanup debugging 2021-12-10 14:00:34 -06:00
Suraj Gupta cb568bbd55 Add watch on config key. 2021-12-10 14:00:34 -06:00
Suraj Gupta 9fbccb21d2 Remove checks from native API. 2021-12-10 14:00:34 -06:00
Suraj Gupta fdb04129cd Fix merge conflict 2021-12-10 14:00:34 -06:00
Suraj Gupta fdc94d3356 Fix blobGranuleVerifier setup. 2021-12-10 14:00:34 -06:00
Suraj Gupta 0f3318a8ba add TODO 2021-12-10 14:00:34 -06:00
Suraj Gupta fc3376fe8f Move client knob to database config for blob granules. 2021-12-10 14:00:34 -06:00
Josh Slocum d31cb07647 ASAN fix 2021-12-10 12:25:42 -06:00
Josh Slocum c95c93b527 removed incorrect assert for now 2021-12-09 17:06:20 -06:00
Josh Slocum 8dc5f79dc7 Made blob worker assume no empty mutations, and made merge cursor not send them 2021-12-09 15:00:46 -06:00
Josh Slocum 1ee0b16bfa Fixed bug in merge cursor whenAtLeast 2021-12-09 14:19:00 -06:00
Josh Slocum 46ac726700 Added assert to more easily detect WFV errors 2021-12-09 11:01:13 -06:00
Josh Slocum 86f6f73518 Merge cursor debugging and fix in BW::waitForVersion 2021-12-09 10:51:31 -06:00
Josh Slocum 845f1ade42 Another incorrect assert 2021-12-08 17:19:28 -06:00
Josh Slocum 5f2640f592 Fixed an assert I added during refactor that was incorrect 2021-12-08 16:40:40 -06:00
Josh Slocum e9e5a80086 Refactored file writing to guarantee consuming all mutations from the change feed promise stream 2021-12-08 16:10:29 -06:00
Josh Slocum b438e98220 Fixed multiple availability bugs in blob worker 2021-12-08 15:47:16 -06:00
Josh Slocum ef74d309d8 Adding delay after onEmpty for merge cursor as well 2021-12-08 12:48:30 -06:00
Josh Slocum 6c79750412 Added a bunch of debugging for tracking whenAtLatest problems, and fixed a bug there 2021-12-08 12:41:45 -06:00
Josh Slocum 4a9c2f4172 fixing merge conflicts 2021-12-08 08:47:58 -06:00
Josh Slocum c5b2b384da Fixing ASAN issues 2021-12-08 08:42:35 -06:00
Josh Slocum 3ee6d69f3d Wait for empty even for whenAtLatest>0 2021-12-08 08:42:35 -06:00
Evan Tschannen a47ce06e26
Merge pull request #6126 from sfc-gh-etschannen/blob_integration
Fixed a few more change feed bugs
2021-12-07 21:02:19 -08:00
Evan Tschannen 9dcdda8192 fix: do not merge rollbacks when fetching 2021-12-07 20:34:01 -08:00
Evan Tschannen 75267aba80 fix: do not update lastReturnedVersion until the client has consumed the mutations 2021-12-07 13:03:50 -08:00
Evan Tschannen d669848ce5
Merge pull request #6118 from sfc-gh-etschannen/blob_integration
fix: merge cursors can have more mutations sent to self->mutations after it goes empty
2021-12-07 09:58:08 -08:00
Evan Tschannen fdd35070a1 fix: merge cursors can have more mutations sent to self->mutations after it goes empty 2021-12-07 09:57:39 -08:00
Evan Tschannen d77b499282
Merge pull request #6113 from sfc-gh-etschannen/blob_integration
Fixed how better master exists interacts with singleton recruitment
2021-12-06 13:56:26 -08:00
Evan Tschannen 67cd11cc20 Merge branch 'blob_integration' of https://github.com/apple/foundationdb into blob_integration 2021-12-06 13:54:51 -08:00
Evan Tschannen 130def7897 fix: make sure both conditions are true before better master exists is executed 2021-12-06 13:50:31 -08:00
Evan Tschannen 951bc4acd7 fix: do not call better master exists until the long lived stateless processes have settled into their desired locations 2021-12-06 13:12:27 -08:00
Josh Slocum 528df86a28 fix: refactored and fixed changeFeedWhenAtLatest returning early 2021-12-06 14:06:17 -06:00
Evan Tschannen 2ab3468934
Merge pull request #6107 from sfc-gh-etschannen/blob_integration
A variety of bug fixes
2021-12-05 20:57:27 -08:00
Evan Tschannen a4fff19320 Revert "fix: long lived stateless processes need to be the last comparison criteria to avoid better master exists from changing behavior from the original recruitment"
This reverts commit b55b095ed0.
2021-12-05 20:26:13 -08:00
Evan Tschannen b55b095ed0 fix: long lived stateless processes need to be the last comparison criteria to avoid better master exists from changing behavior from the original recruitment 2021-12-05 20:18:03 -08:00
Evan Tschannen 02c650c6e7 fix: sending to mutations can cause whenAtLeast to update lastReturnedVersion before we have a chance to 2021-12-05 16:16:20 -08:00
Evan Tschannen 13ef5afb9c reject blob workers joining from the wrong data center
we must run the checkblobworkers actors even on epoch 1
check for an already killed worker even right after it is recruited
2021-12-05 15:02:25 -08:00
Evan Tschannen 98b4299fb2 .error() on a trace event must be before the details 2021-12-05 14:59:46 -08:00
Evan Tschannen da9c42fd9e do not log transaction metrics in simulation 2021-12-05 14:59:24 -08:00
Evan Tschannen ff47013158 fix: check if the master has been killed while waiting for getNextBMEpoch 2021-12-04 17:08:23 -08:00