cefb66d64c
fixing a couple bugs
2021-09-10 12:52:33 -05:00
e2a51a4fe7
Fixing up after change feed updates
2021-09-10 11:49:41 -05:00
c2d1d1704f
Merge branch 'feature-range-feed' into blob_full
2021-09-10 11:21:52 -05:00
ac5b580e2d
Merge branch 'master' into feature-range-feed
...
# Conflicts:
# fdbcli/fdbcli.actor.cpp
# fdbclient/StorageServerInterface.cpp
# fdbclient/StorageServerInterface.h
# fdbserver/ApplyMetadataMutation.cpp
# fdbserver/TLogServer.actor.cpp
# flow/error_definitions.h
2021-09-09 23:13:22 -07:00
44a64005cf
also pipelining snapshot from blob in blob worker for maximum throughput
2021-09-09 10:43:28 -05:00
99e5ecdf9d
Doing GRVs for committed version checking in blob worker
2021-09-08 17:24:49 -05:00
2491287f98
Pipelined delta file writing to improve performance
2021-09-08 16:57:57 -05:00
eb76343dfb
Added blob granule reassignment and splitting
2021-09-08 14:09:14 -05:00
590da022ee
fix: missing mutations committed at newOldestVersion
2021-09-07 16:20:49 -07:00
f53ddf6720
fix: handle the case where I change feed is added while a fetch is in progress
2021-09-06 13:51:53 -07:00
7b23894039
fixed a few bugs related to change feed fetches
2021-09-05 20:33:12 -07:00
9fefd59076
Fixed a number of bugs, change feeds are correctness clean with the current workload
2021-09-05 18:17:23 -07:00
af0792b1f5
fixes that allow change feeds to pass correctness in tests with no failures
2021-09-03 17:24:33 -07:00
367c7cda92
fixed problems with the change feed workload
2021-09-03 15:14:28 -07:00
87b001ef7b
Merge pull request #5538 from sfc-gh-clin/fix-disableTss-master
...
Fix reading the disableTss option
2021-09-03 14:23:28 -07:00
b02e8d99c6
added a workload to test change feeds
2021-09-03 14:19:27 -07:00
b9e4bb7217
Fix reading the disableTss option
2021-09-03 12:47:02 -07:00
2aa0a5cf58
The lock special key has the lock UID as the value
2021-09-03 12:15:56 -07:00
8309c2ce26
filter mutations in change feeds to the requested range
2021-09-03 12:06:13 -07:00
5aebd77f0a
PR changes
2021-09-03 13:58:39 -04:00
a0b3446572
Add metrics for blob worker.
...
We want to add metrics for the blob worker to evaluate its
performance more concretely. We decided to track the following
information:
- s3 put requests
- s3 get requests
- S3 delete requests
- Delta files written
- Snapshot files written
- Delta bytes written
- Snapshot bytes written
- Number of current ranges assigned
- Bytes read from FDB (initial snapshot)
- Bytes read from S3 (compaction)
- Read requests count
- Read files returned
- Read deltas returned
- Read delta bytes returned
- Ranges assigned
- Ranges revoked
- Number of current ranges assigned
- Total mutation bytes buffered across all ranges // current or accumulated
- Range feed bytes input
- Range feed mutations input
- Wrong Shard Server count
2021-09-03 12:09:01 -04:00
bdbb0303f3
Add missing wait around deleteFile invocations.
2021-09-03 11:12:03 -04:00
4bbae59bb0
Fixed a few bugs and added a backup popping mechanism
2021-09-02 21:11:44 -07:00
51920ffa16
RecruitFromConfigurationRetry should wait for goodRecruitmentTime to be ready
2021-09-02 09:32:08 -07:00
fccfe3af78
Address PR comments.
2021-09-02 12:09:37 -04:00
c27d8f3336
Improve assignment of range granules.
...
Previously, we randomly picked a worker to assign a range to.
Now, we pick a worker that has the least number of range granules
already assigned, ultimately distributing the workload in a more
efficient manner.
Future iterations should also consider the number of read/writes
that a worker is already handling when picking a worker to assign
a range to. This could prevent us from assigning a range to a worker
that is already hot.
2021-09-01 23:36:52 -04:00
27151b0831
support reads from range feeds that span multiple storage servers
2021-09-01 14:35:51 -07:00
ff96843c58
review comments
2021-09-01 10:12:53 -05:00
f7842ff3db
Log SubCode and Severity for RocksDB erros ( #5515 )
2021-08-31 21:03:02 -07:00
46adada5ff
Cleaned up debugging and fixed a couple bugs
2021-08-31 12:30:43 -05:00
2d298355a5
Merge pull request #5489 from halfprice/zhewu/remote-checkregion-in-health-checking
...
Remove checkRegions in shouldTriggerRecoveryDueToDegradedServers
2021-08-30 15:15:42 -07:00
a574661bc3
Remove unnecessary temporary object from ApiCorrectnessWorkload::getMetrics
2021-08-30 13:33:25 -07:00
6e4f74c9b3
Remove checkRegions in shouldTriggerRecoveryDueToDegradedServers
2021-08-30 13:03:14 -07:00
bbeec49533
added range mover
2021-08-30 13:59:53 -05:00
b4bfd58bcb
multiple blob workers appears to work
2021-08-30 13:07:25 -05:00
e918d20f68
Document "averaged" parameter of PerfMetric constructor
2021-08-29 15:38:21 -07:00
e576fd45f5
Merge pull request #5496 from xis19/master
...
Refactor TxnStateRequest handler in commitProxyServerCore
2021-08-29 11:14:45 -07:00
e6b8a519c4
fixup! Make processTransactionStateRequestPart not blocking
2021-08-28 21:10:10 -07:00
74d8ca87d7
Refactor TxnStateRequest handler in commitProxyServerCore
2021-08-27 23:38:34 -07:00
86c6c2b643
Merge remote-tracking branch 'origin/master' into paxos-config-db
2021-08-27 23:24:14 -07:00
69508b980f
modify comments to make clang-format and coverage tool play nice
2021-08-27 17:18:00 -07:00
2c788c233d
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-08-27 17:07:47 -07:00
3a880b43d4
Fix and reenable PaxosConfigTransaction::onError
2021-08-27 15:06:33 -07:00
3b011408f8
Added sequence numbers and locks to blob worker and manager
2021-08-27 16:33:07 -05:00
ad99f025e3
Merge remote-tracking branch 'origin/master' into paxos-config-db
2021-08-27 14:13:34 -07:00
bf982644cf
For now, ConfigIncrement workload passes even if clients get stuck
2021-08-27 13:46:08 -07:00
d706a7ddd7
Merge pull request #5474 from sfc-gh-ajbeamon/unit-tests-require-match
...
Unit tests require a match from the test pattern in order to be successful
2021-08-27 09:17:23 -07:00
29d83291a1
Add CommitUnknownResult metric for ConfigIncrement workload
2021-08-27 00:44:12 -07:00
28f3481656
Remove unnecessary debugging trace events
2021-08-26 17:13:39 -07:00
7f8a1385d5
Merge remote-tracking branch 'origin/master' into paxos-config-db
2021-08-26 17:00:43 -07:00
Josh Slocum