7e094f217b
Merge pull request #3675 from ajbeamon/fix-proxy-latency-bands
...
Fix commit and GRV latency band and statistics publishing
2020-08-22 10:53:33 -07:00
a552181c48
Merge pull request #3652 from satherton/feature-redwood
...
Optimization to reduce page writes when multiple siblings of the same parent are updated with the page remap window
2020-08-21 17:14:31 -07:00
6380b92b10
Don't block the data distributor when getting a GetDataDistributorMetricsRequest.
2020-08-21 09:26:18 -07:00
9dd4589d61
Fix merge issue that resulted in commit and GV latency band info not being published.
2020-08-20 11:49:30 -07:00
d53e6cf687
Bug fix in KV byte counts.
2020-08-18 17:58:57 -07:00
090241f0df
Count BTreeCursor page reads that come from the cursor's cache of pages as cache hits in RedwoodMetrics. BTree Unit Test now verifies all data at the initial version after recovery from disk.
2020-08-15 14:30:49 -07:00
84a4d040c1
Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-redwood
2020-08-15 14:09:03 -07:00
94571786bf
Add RocksDB work
2020-08-14 17:16:20 +00:00
ce05bb2a26
Merge pull request #3617 from xumengpanda/tmp/trace-PR
...
Resolve throttling events
2020-08-13 16:31:55 -07:00
051ec7066a
BTree unit test duration now targets a number of page read/writes so it should time out less often.
2020-08-13 01:50:51 -07:00
e13e7c5725
Update fdbserver/workloads/ReadHotDetection.actor.cpp
...
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2020-08-12 15:48:01 -07:00
b17667323e
Resolve review comments
2020-08-12 15:15:25 -07:00
3ac6996844
Increased some knobs to throttle the spammy read hot logging. Also added more details inside the read hot log to make it useful
2020-08-12 14:27:34 -07:00
215a0ad42c
Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-redwood
2020-08-12 12:06:56 -07:00
0d0efcfce7
FR:Fix incorrect ASSERT:batchIndex starts at 1 instead of 0
2020-08-12 10:36:31 -07:00
a817c9abbe
Redwood metrics was adding details with empty names.
2020-08-12 03:24:23 -07:00
729fce9f0e
Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-redwood
2020-08-12 02:59:01 -07:00
c1ccbc3d27
Bug fixes. Internal page update would be missed if child page ID updates were expected but none were done. When rebuilding internal pages, child page ID updates were being written to the original page memory instead of the rebuild record set.
2020-08-12 01:33:07 -07:00
06dae74730
Revert change to ReadHotRangeLog event
2020-08-11 11:04:57 -07:00
97e49f2f70
Resolve throttling events
2020-08-10 22:01:12 -07:00
c5c6906a3d
Merge pull request #3600 from xumengpanda/mengxu/fr-fix-large-pkg-PR
...
Fast Restore: Fix the sampling packet size at sampling phase
2020-08-10 13:53:24 -07:00
c18d16ad30
Multiple sibling page updates within the remap cleanup window can now avoid the second update step, copying updated contents over the original page, by instead updating the parent page to point to the new sibling locations.
2020-08-09 03:04:38 -07:00
c89a62b935
FR:SampleBackup:Assert req.batchIndex < controller batch size
2020-08-07 16:52:07 -07:00
c27542d4e9
FR:SampleBackup:Send reply when receive duplicate msg
2020-08-07 16:50:36 -07:00
fccebd9b80
FR:Use ByteSampleInfo to accurately sample backup
2020-08-06 20:45:46 -07:00
87bde08695
FR:fix:sending samples may have broken promise error
...
The error should not skip the ack reply from loader to controller, saying
the file has been loaded.
Otherwise, restore controller can get stuck at waiting for the ack reply.
2020-08-06 10:41:18 -07:00
ca5705b5ea
Merge pull request #3576 from Daniel-B-Smith/rocksdb-fixes
...
RocksDB fixes
2020-08-05 11:32:22 -07:00
859c3145e2
FR:Fix samples not send reply and false positive failures
2020-08-05 11:32:04 -07:00
309f383be3
FR:Report error if controller throws error
2020-08-04 23:08:41 -07:00
879998d01b
FR:fix compilation error
2020-08-04 23:04:38 -07:00
7992cef025
FR:Fix sample network pkg can be too big
2020-08-04 22:35:21 -07:00
e9adec421d
FR:Add controller interface and send to roles
2020-08-03 15:06:15 -07:00
f071d81ad0
Report warning on FastRestoreApplierClearRangeMutationsStart if delayTime is too large
2020-08-03 14:08:31 -07:00
0c49646486
Fix:FastRestore:rangeVersion must be 0 when no range file is used
...
otherwise, all mutations will be ignored by loaders as old mutations
2020-07-31 23:23:17 -07:00
27a3d37594
RestoreApplier:Change receivedBytes from double to long
2020-07-31 22:10:18 -07:00
e22baa552b
FastRestoreApplier:Init stats variables
2020-07-31 21:56:03 -07:00
f36d5aa180
FR:Applier received bytes per batch
2020-07-31 17:48:55 -07:00
fec3de9b7b
Fix RestoreLoader loadedLogBytes counter
2020-07-31 16:00:15 -07:00
47c35a7a69
FastRestore:Add stats to ApplierBatchData
2020-07-31 14:59:45 -07:00
e4d2ab72fe
DumpVersionBatch with log and file summary info
2020-07-31 14:21:33 -07:00
2f5293fcc7
Introduce knob FASTRESTORE_USE_LOG_FILE and FASTRESTORE_USE_RANGE_FILE
2020-07-31 10:40:29 -07:00
37c3bd8615
FastRestore:Ensure FASTRESTORE_NOT_WRITE_DB only work in non simulation mode
2020-07-30 20:27:54 -07:00
8cace30bb2
FastRestore:change TXN_BATCH_MAX_BYTES default to 1KB from 1MB
2020-07-30 16:43:35 -07:00
d16db8e733
FastRestore:Fix segmentation fault
2020-07-30 12:10:32 -07:00
d71361245b
FastRestore:Short cut DB for get and clearange
2020-07-30 11:17:05 -07:00
ad915e462e
Add knob FASTRESTORE_NOT_WRITE_DB to skip writting to DB
2020-07-30 10:17:17 -07:00
6efd5996c2
Calculate data stored by Rocks
2020-07-29 22:08:32 +00:00
fd973e5055
RocksDB fixes
2020-07-29 21:26:36 +00:00
2b8aa296bb
Merge pull request #3482 from sfc-gh-tclinkenbeard/support-downgrades
...
Support and test downgrades
2020-07-28 17:00:54 -07:00
d2cf700bd4
Fix compiler warnings
2020-07-28 18:30:26 +00:00
Meng Xu