cfb8368da6
Address PR comments.
2021-10-13 14:56:17 -04:00
d002df3b21
Clean up blob worker changes.
2021-10-13 14:40:26 -04:00
ef67feed67
Clean up blob manager changes.
2021-10-13 14:40:26 -04:00
266a5b06fa
Fix infinite loop.
2021-10-13 14:40:26 -04:00
423a67f448
trying to fix infinite loop
2021-10-13 14:40:26 -04:00
dfb9655c57
Handle blob work failure
2021-10-13 14:40:26 -04:00
2ec8781224
Merge knobs into one.
2021-10-13 14:00:37 -04:00
9d4b55c7fe
Gate the blob verifier as well.
2021-10-13 11:45:51 -04:00
5a6a052c55
Add a knob to gate blob-related work.
2021-10-13 09:48:02 -04:00
bbe7c7ca9f
found change feed liveness bug
2021-10-06 12:32:16 -05:00
4e4a2534da
review comments and moving priority yield to correct spot
2021-10-06 09:24:48 -05:00
6a24ef9258
adding priorities to blob worker and fixing monitoring in blob manager
2021-10-05 16:51:19 -05:00
95166796cd
Address PR comments.
2021-10-04 20:16:22 -04:00
282f9d35cd
Cleanup comments and debugging code.
2021-10-04 11:07:08 -04:00
4d54669ccd
Recruit the blob workers via blob manager.
...
In this PR, the blob manager now recruits blob workers
(via communication with the cluster controller). Blob workers
are onboarded as blob worker processes enter the cluster.
2021-10-04 11:07:08 -04:00
04682c9091
Merge pull request #14 from sfc-gh-sgupta/blob-worker-process-class
...
Add exclusive process class for blob worker.
2021-10-04 10:03:02 -05:00
ac14856307
Add BWs to every DC in simulated cluster.
2021-09-27 11:17:37 -04:00
8fb7c45e65
even more bug fixes
2021-09-25 10:30:27 -05:00
3b23d6aba5
rollback fixes
2021-09-25 09:19:00 -05:00
fa1fe5f08b
added blob worker rollbacks that handle (most) cases
2021-09-24 17:52:36 -05:00
0ca00ce53b
Address PR comments.
...
Add support for more than 1 blob worker in simulated cluster.
We now have at least 2, and up to 7 (randomly).
Also removed the ability for blob workers to onboard onto
unset processes.
2021-09-24 12:17:56 -04:00
a986679b7f
More bug fixes
2021-09-24 10:02:02 -05:00
a4bcd3919d
Add exclusive process class for Blob Worker.
...
Also introduces a specific machine in the simulated cluster
to test blob worker (similar to what's done for storage cache).
2021-09-23 16:54:44 -04:00
889ae3f255
Address PR comments.
...
Remove nukeBlobWorkerData, simplify checkManagerLock call and make
final choose...when consistent.
2021-09-23 14:09:56 -04:00
d675e6b143
Kill BM by returning, instead of throwing.
2021-09-23 11:41:57 -04:00
8c49f1f238
Improve actor management and handling of failure in BM.
2021-09-23 10:58:38 -04:00
5fa6c687d6
Add blob manager as a singleton.
2021-09-23 10:45:37 -04:00
95c004f80b
Add missing namespace qualifier to vector.
2021-09-22 16:57:04 -05:00
2b9dfc1371
Simplify count increments.
2021-09-22 16:56:59 -05:00
4530e746d6
Address PR comments.
...
Adds comment for constant and changes method name for `setonDb`.
2021-09-22 16:56:49 -05:00
4a71f3d0f8
Fix recruitment bug.
2021-09-22 16:56:44 -05:00
72edcd8d73
Address PR comments.
...
Revert knob name change, fix comparison between new and old
recruitments, and get rid of empty `if` block.
2021-09-22 16:56:34 -05:00
10807ddebc
Rename function to be more clear.
2021-09-22 16:56:27 -05:00
0b6fecddbc
Refactor logic for recruiting singletons.
...
This commit refactors the logic for recruiting singletons,
which is done by the ClusterController. This allows for far
easier additions of new singletons in the future, and also
cleans up the code.
Also, the logic for recruiting DD was changed to mirror
the logic for recruiting RK. Although the logic for RK
allows there to be many RKs existing at once, the moveKeysLock
mechanism used by DD still prevents multiple DDs existing at once.
2021-09-22 16:56:18 -05:00
5ddf08dfe5
Got basic range reassignment working
2021-09-22 16:48:44 -05:00
ccb78b1ce5
more CF bug fixes
2021-09-21 13:20:27 -05:00
8e4582673c
more bug fixes
2021-09-20 10:21:52 -05:00
9a92b763ae
Fixing issues in known committed version tracking
2021-09-17 12:26:10 -05:00
57176a4955
Increasing workload request count
2021-09-16 10:03:30 -05:00
c9b8bdffbe
Passes a single correctness test!
2021-09-15 17:18:04 -05:00
cefb66d64c
fixing a couple bugs
2021-09-10 12:52:33 -05:00
e2a51a4fe7
Fixing up after change feed updates
2021-09-10 11:49:41 -05:00
c2d1d1704f
Merge branch 'feature-range-feed' into blob_full
2021-09-10 11:21:52 -05:00
ac5b580e2d
Merge branch 'master' into feature-range-feed
...
# Conflicts:
# fdbcli/fdbcli.actor.cpp
# fdbclient/StorageServerInterface.cpp
# fdbclient/StorageServerInterface.h
# fdbserver/ApplyMetadataMutation.cpp
# fdbserver/TLogServer.actor.cpp
# flow/error_definitions.h
2021-09-09 23:13:22 -07:00
44a64005cf
also pipelining snapshot from blob in blob worker for maximum throughput
2021-09-09 10:43:28 -05:00
99e5ecdf9d
Doing GRVs for committed version checking in blob worker
2021-09-08 17:24:49 -05:00
2491287f98
Pipelined delta file writing to improve performance
2021-09-08 16:57:57 -05:00
eb76343dfb
Added blob granule reassignment and splitting
2021-09-08 14:09:14 -05:00
590da022ee
fix: missing mutations committed at newOldestVersion
2021-09-07 16:20:49 -07:00
f53ddf6720
fix: handle the case where I change feed is added while a fetch is in progress
2021-09-06 13:51:53 -07:00
Suraj Gupta