cefb66d64c
fixing a couple bugs
2021-09-10 12:52:33 -05:00
e2a51a4fe7
Fixing up after change feed updates
2021-09-10 11:49:41 -05:00
c2d1d1704f
Merge branch 'feature-range-feed' into blob_full
2021-09-10 11:21:52 -05:00
ac5b580e2d
Merge branch 'master' into feature-range-feed
...
# Conflicts:
# fdbcli/fdbcli.actor.cpp
# fdbclient/StorageServerInterface.cpp
# fdbclient/StorageServerInterface.h
# fdbserver/ApplyMetadataMutation.cpp
# fdbserver/TLogServer.actor.cpp
# flow/error_definitions.h
2021-09-09 23:13:22 -07:00
9df392f447
Merge pull request #5528 from sfc-gh-clin/refactor-fdbcli
...
Refactor fdbcli, get rid of RYWTransaction, refactor status command
2021-09-09 10:31:34 -07:00
44a64005cf
also pipelining snapshot from blob in blob worker for maximum throughput
2021-09-09 10:43:28 -05:00
30e7469b19
Update fdbclient/MultiVersionTransaction.actor.cpp
2021-09-08 17:37:33 -07:00
ab29bf05af
Solve PR comments
2021-09-08 16:38:42 -07:00
1cbd45055c
Merge branch 'granule_write_improvements' into blob_full
2021-09-08 17:31:20 -05:00
d38c5b4b02
Merge pull request #12 from sfc-gh-jslocum/granule_splitting
...
Added blob granule splitting
2021-09-08 17:27:31 -05:00
99e5ecdf9d
Doing GRVs for committed version checking in blob worker
2021-09-08 17:24:49 -05:00
2491287f98
Pipelined delta file writing to improve performance
2021-09-08 16:57:57 -05:00
eb76343dfb
Added blob granule reassignment and splitting
2021-09-08 14:09:14 -05:00
8cc3f3f49d
Code format
2021-09-08 10:56:32 -07:00
84a2672a33
Merge branch 'master' of github.com:apple/foundationdb into refactor-fdbcli
2021-09-08 10:42:59 -07:00
8cef044a8b
Remove commented code; simplify code
2021-09-08 10:42:46 -07:00
af5643c998
Fix the issue in CheckStatus where it stuck as we cannot talk to any of the coordinators
2021-09-08 10:05:13 -07:00
d9782bc29d
fixed a few bugs with merging change feeds on the client
2021-09-07 21:35:00 -07:00
52a2f56fe2
Merge pull request #5553 from apple/documentation_setuptoolz
...
put upper bound on setuptools version
2021-09-07 20:02:38 -07:00
c07c0ac4fc
put upper bound on setuptools version
2021-09-07 18:10:47 -07:00
590da022ee
fix: missing mutations committed at newOldestVersion
2021-09-07 16:20:49 -07:00
99cc042d9c
Fix ProfileCommand.actor.cpp, using the correct way to read from global config
2021-09-07 11:06:47 -07:00
f53ddf6720
fix: handle the case where I change feed is added while a fetch is in progress
2021-09-06 13:51:53 -07:00
7b23894039
fixed a few bugs related to change feed fetches
2021-09-05 20:33:12 -07:00
9fefd59076
Fixed a number of bugs, change feeds are correctness clean with the current workload
2021-09-05 18:17:23 -07:00
af0792b1f5
fixes that allow change feeds to pass correctness in tests with no failures
2021-09-03 17:24:33 -07:00
d6e7617043
Merge pull request #5540 from sfc-gh-clin/fix-where-old-binary-not-present
...
Return if no available old binary in the given range
2021-09-03 15:19:16 -07:00
367c7cda92
fixed problems with the change feed workload
2021-09-03 15:14:28 -07:00
0d1382eeba
Add comments for the change
2021-09-03 14:32:27 -07:00
87b001ef7b
Merge pull request #5538 from sfc-gh-clin/fix-disableTss-master
...
Fix reading the disableTss option
2021-09-03 14:23:28 -07:00
97050ac33f
Merge pull request #5536 from sfc-gh-clin/change-lock-special-key
...
The lock special key has the lock UID as the value
2021-09-03 14:23:11 -07:00
56ed0f3b9c
Return if no available binary in the given range
2021-09-03 14:21:16 -07:00
b02e8d99c6
added a workload to test change feeds
2021-09-03 14:19:27 -07:00
b9e4bb7217
Fix reading the disableTss option
2021-09-03 12:47:02 -07:00
4671fe57ab
Merge pull request #10 from sfc-gh-sgupta/blob-worker-metrics
...
Add metrics to blob worker
2021-09-03 14:16:59 -05:00
2aa0a5cf58
The lock special key has the lock UID as the value
2021-09-03 12:15:56 -07:00
8309c2ce26
filter mutations in change feeds to the requested range
2021-09-03 12:06:13 -07:00
66166839fd
Add BlobWorkerCommon to CMakeLists.
2021-09-03 15:05:35 -04:00
5aebd77f0a
PR changes
2021-09-03 13:58:39 -04:00
f7002e2a66
Merge pull request #5495 from sfc-gh-ajbeamon/network-thread-busyness-burstiness-score
...
Busyness API incorporates a burstiness score based on the max busyness interval in a measurement period
2021-09-03 10:29:28 -07:00
afd8df4bb9
Merge commit '7f2b6c2c7ec2efcd7339e3c6531e4906322477c3' into network-thread-busyness-burstiness-score
2021-09-03 09:48:11 -07:00
a0b3446572
Add metrics for blob worker.
...
We want to add metrics for the blob worker to evaluate its
performance more concretely. We decided to track the following
information:
- s3 put requests
- s3 get requests
- S3 delete requests
- Delta files written
- Snapshot files written
- Delta bytes written
- Snapshot bytes written
- Number of current ranges assigned
- Bytes read from FDB (initial snapshot)
- Bytes read from S3 (compaction)
- Read requests count
- Read files returned
- Read deltas returned
- Read delta bytes returned
- Ranges assigned
- Ranges revoked
- Number of current ranges assigned
- Total mutation bytes buffered across all ranges // current or accumulated
- Range feed bytes input
- Range feed mutations input
- Wrong Shard Server count
2021-09-03 12:09:01 -04:00
bdbb0303f3
Add missing wait around deleteFile invocations.
2021-09-03 11:12:03 -04:00
4bbae59bb0
Fixed a few bugs and added a backup popping mechanism
2021-09-02 21:11:44 -07:00
7f2b6c2c7e
Merge pull request #5532 from sfc-gh-clin/fix-nightly-restarting-tests
...
Handle the edge case correctly when the upper bound version is less than the binary version
2021-09-02 20:10:01 -07:00
8622363395
Simplify the condition and update the comment
2021-09-02 18:51:39 -07:00
3ad620b2df
Update comment to be more clear
2021-09-02 18:13:04 -07:00
e7028b7915
Handle the edge case correctly when the upper bound version is less than the binary verion
2021-09-02 17:42:46 -07:00
a4a7d61252
Merge pull request #5529 from sfc-gh-clin/fix-nightly-restarting-tests
...
Add syntax until_*.*.* in restarting test to specify upper bound of binary version
2021-09-02 16:14:27 -07:00
82e1e850c2
Add syntax until_*.*.* in restarting test to specify upper bound of binary version
2021-09-02 14:07:15 -07:00
Josh Slocum