wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
20,494 Commits 34 Branches 304 Tags 265 MiB
Commit Graph

135 Commits

Author SHA1 Message Date
He Liu 78dc7c5d77 Resolving comments. 2022-05-19 13:27:21 -07:00
He Liu 54c566e57d Drop RocksDB column family before create a new column family from 
import.
 2022-05-19 13:27:21 -07:00
He Liu 05bbe174c3 Implemented checkpoint(), restore() for KeyValueStoreRocksDB, for the 
new format.
 2022-05-19 13:27:21 -07:00
Neethu Haneesha Bingi 93f9ea9a5b Adding rocksdb throttling counters to trace event. 2022-05-05 17:42:26 -04:00
Zhe Wang 6c9ff6ee5e
Add sharded rocksdb type (#6862) 
* add-sharded-rocksdb-type

* address comments

Co-authored-by: Zhe Wang <zhewang@Zhes-MacBook-Pro.local>
 2022-04-21 22:53:14 -04:00
Neethu Haneesha Bingi 6543bce8ae RocksDb using aggr property metrics for pendingCompactionBytes. 2022-04-14 18:08:42 -07:00
Zhe Wang 2f75a4bd78
Use actor collection for rocksdb histogram actors. (#6805) 
Co-authored-by: Zhe Wang <zhewang@Zhes-MacBook-Pro.local>
 2022-04-13 14:41:54 -07:00
neethuhaneesha b7096c410f
Merge pull request #6795 from neethuhaneesha/rocksdb-blocksize 
Adding rocksdb block size option.
 2022-04-08 14:20:54 -07:00
Zhe Wang 37054af7e2
Fix RocksDB Metrics (#6803) 
* fix-metrics-in-rocksdb

* remain-GetIntProperty-for-checkRocksdbState

Co-authored-by: Zhe Wang <zhewang@Zhes-MacBook-Pro.local>
 2022-04-08 17:07:22 -04:00
Zhe Wang 3d325940ad
Fix data race issue when multithreaded RocksDB store using histogram (#6766) 
* using-ThreadReturnPromiseStream-to-make-histogram-thread-safe

* address-comment-and-verify-functionality-in-cluster

* remove-old-histogram-metrics

* fix-comment

Co-authored-by: Zhe Wang <zhewang@Zhes-MacBook-Pro.local>
 2022-04-07 00:31:36 -04:00
Neethu Haneesha Bingi 0d05669c22 Adding rocksdb block size option. 2022-04-06 19:15:17 -07:00
Zhe Wang 37c7b3ff18 fix-rocksdb-blockcache-recreation-problem 2022-03-29 12:07:41 -04:00
Zhe Wang 383b0cf0e1 add-rocksdb-memory-usage-metrics 2022-03-23 15:59:32 -04:00
Neethu Haneesha Bingi 790ef9ff36 Adding rocksdb compaction readahead size option. 2022-03-22 13:29:35 -07:00
sfc-gh-tclinkenbeard 1aabbb07d2 Add missing copyright headers 2022-03-16 11:25:02 -07:00
He Liu c3a68d661e
Physical Shard Move (#6264) 
Physical Shard Move part I: Checkpoint creation, transfer and restore.
 2022-03-15 13:03:23 -07:00
neethuhaneesha 212deb05e9
Merge pull request #6501 from neethuhaneesha/rocksdb-CompBytesLimiter 
Rocksdb knobs for compaction, storageserver canCommit() waiting if rocksdb overloaded
 2022-03-07 14:59:34 -08:00
Yao Xiao 36edfb8820
Update error type for timeouts. (#6503) 2022-03-07 13:14:20 -08:00
Neethu Haneesha Bingi 8796a763a5 Rocksdb knobs for compaction, storageserver canCommit() waiting if rocksdb overloaded. 2022-03-04 12:41:17 -08:00
Neethu Haneesha Bingi 83e0368eaa RocksDB increasing background threads to speedup compaction. 2022-03-03 15:14:37 -08:00
Zhe Wang f14e08a991 addRocksDBPerfContextMetrics 2022-02-23 22:29:07 -05:00
Aaron Molitor 96dd86ebf8 update RocskDB and Boost 
add Finduring, and include into fdbserver
add BOOST asio/uring settings to fdbserver compile
move portable rocks, liburing up to be configurable at build time.
 2022-02-09 10:48:18 -06:00
Yao Xiao c605226a56
Add error handling in RocksDB KVS. (#6277) 2022-01-25 13:59:25 -08:00
Neethu Haneesha Bingi 162bce7a58 Rocksdb write rate limiter. 2022-01-18 13:23:00 -08:00
Neethu Haneesha Bingi ef4038fe8d Rocksdb read range iterator pool to reuse iterators. 2022-01-18 02:05:21 -08:00
He Liu 1c2c2783ea Implement single deletion in RocksDB. 
If the target deletion range contains a single key, convert it into a
single deletion, to avoid extra cost in RocksDB due to range deletion.
 2022-01-04 09:59:40 -08:00
Neethu Haneesha Bingi 1f30368e71 KeyValueStoreRocksDB histograms to track latencies 2021-12-21 23:09:46 -08:00
Neethu Haneesha Bingi d23b8645f8 Enabling rocksdb metrics logger in simulation. 2021-12-07 15:18:29 -08:00
Daniel Smith 9dccb0131e Clean up RocksDB error logging 2021-11-12 12:14:12 -05:00
Daniel Smith 394b9dc619 Code review changes 2021-11-10 11:53:27 -05:00
Daniel Smith 66520eb1c1 Utilize read types to do selective throttling 2021-11-10 11:51:04 -05:00
Daniel Smith 8822c589de Move table factory options to CFOptions 2021-11-09 17:29:06 -05:00
sfc-gh-tclinkenbeard 421dee532c Add const qualifiers in KeyValueStoreRocksDB.actor.cpp 2021-10-18 13:40:47 -07:00
Daniel Smith 9713a14ef1 Reverse order of read type and debug ID args 2021-10-18 12:23:09 -04:00
Daniel Smith df53cc9580 Add an enum to IKeyValueStore to indicate the source/priority of the read 2021-10-15 14:35:59 -04:00
Neethu Haneesha Bingi 3c35bc69d7 Decoupling the rocksdb version check to multiple static asserts. 2021-09-17 08:53:23 -07:00
Neethu Haneesha Bingi c0e6b09fe3 Enforcing 6.22.1 rocksdb version and enabling readRange deadline option. 2021-09-17 08:53:23 -07:00
Neethu Haneesha Bingi 627ef2e739 Enable rocksdb storage in simulation with some simulation fixes. 2021-09-10 11:11:29 -07:00
yao-xiao-github f7842ff3db
Log SubCode and Severity for RocksDB erros (#5515) 2021-08-31 21:03:02 -07:00
Daniel Smith b75fb0d105 Improve error to status conversion 2021-08-23 11:35:26 -04:00
Daniel Smith 473e2bbf5f Fix error handling of reads. 2021-08-23 11:35:26 -04:00
Neethu Haneesha Bingi 0fbfcc582e Increasing the read cancellation timeouts to 5 minutes in simulation. 2021-08-19 14:47:12 -07:00
Neethu Haneesha Bingi 6c97782378 Timedout reads cancellation check removed in simulation. 2021-08-19 14:11:28 -07:00
Neethu Haneesha Bingi 02b3ed3ff1 Adding deadline option to rocksdb calls. 2021-08-19 14:11:28 -07:00
Neethu Haneesha Bingi fbb393f998 Added readrange timeoout check and rocksdb read deadline option. 2021-08-19 14:11:28 -07:00
Neethu Haneesha Bingi 24ac173c95 Adding ReadRangeAction timeout, returning error and using timer_monotonic changes. 2021-08-19 14:11:28 -07:00
Neethu Haneesha Bingi 01e85610ab Cancelling the timedout reads with rocksdb storage. 2021-08-19 14:11:28 -07:00
yao-xiao-github b8e2575f92
Update log directory to server log directory. (#5396) 2021-08-18 13:07:56 -07:00
Daniel Smith adc466acb6 Fix key name 2021-07-30 13:27:43 -04:00
Daniel Smith a26dbba66f Add RocksDB metrics 2021-07-30 13:27:43 -04:00