Commit Graph

105 Commits

Author SHA1 Message Date
sfc-gh-tclinkenbeard a71099471b Update copyright header dates 2022-03-21 13:36:23 -07:00
Steve Atherton 30957c3a43 Fix unclear comment. 2022-03-10 14:22:45 -08:00
Steve Atherton a32c3a2891 Redwood now uses one global page cache eviction order and size limit for all page sizes, for real or virtual processes, and DecodeCache memory is counted against the global page cache budget. 2022-02-25 03:20:53 -08:00
Steve Atherton 0f5535fce1 Remove explicit tryEvict(x) as it is unused and it is functionally replaced by prioritizeEviction(x). 2021-11-27 03:26:34 -08:00
Steve Atherton 3901d60548 Test-only bug fixes in Redwood along with debug logging detail improvements. Added clearRemapQueue() to Pager to more cleanly and reliably expire all old data and process the remap queue, fixing a bug where with certain configuration parameters and a lot of data the DestructiveSanityCheck would fail because it would not run cleanup long enough. Added more parameters to performance/set unit test. 2021-11-19 01:00:14 -08:00
Steve Atherton 84854761cb Change Redwood to use xxhash for checksums. 2021-11-02 21:47:31 -07:00
Steve Atherton b75edbda31 Merge branch 'master' of github.com:apple/foundationdb into RedwoodSuperpage
# Conflicts:
#	fdbserver/VersionedBTree.actor.cpp
2021-10-25 00:55:52 -07:00
Fuheng Zhao de2afc6d9a conver to standalone in earlier stage to improve the throughput 2021-09-17 15:57:59 -07:00
Fuheng Zhao 0829230e66 format IPager.h 2021-09-10 11:32:43 -07:00
Steve Atherton b06cf7a328 Redwood commit versions are now FDB commit versions for storage instances. Redwood no longer makes internal commits during Pager or BTree recovery so that commit version is always set by the user. 2021-09-10 03:28:46 -07:00
Fuheng Zhao 19e3132632 remove the extra space in these two files 2021-09-07 16:17:32 -07:00
Fuheng Zhao 9aab561f30 format 2021-09-07 16:13:13 -07:00
Fuheng Zhao feab3c4cf8 revert back changes in tracking cache size 2021-09-07 09:08:26 -07:00
Fuheng Zhao 82929fe40e check the thoroughput without the keeping the size 2021-09-03 10:24:21 -07:00
Fuheng Zhao 3bb9ba0687 check the single page vs multi page in upper readPage function call 2021-09-02 15:42:39 -07:00
Fuheng Zhao a94cb058e2 readPage and readMultiPage 2021-09-02 11:46:39 -07:00
Fuheng Zhao 16f864f2de need to debug segfault 2021-09-01 16:15:20 -07:00
Fuheng Zhao 17f2ff4c1b avoid unnecessary function calls 2021-08-31 10:41:25 -07:00
Fuheng Zhao e82706c86b change Standalone<VectorRef> to VectorRef 2021-08-09 14:49:37 -07:00
Fuheng Zhao 2aadffdb3d debugging segfault 2021-08-05 14:48:25 -07:00
Fuheng Zhao 0205f37d53 format 2021-08-03 14:19:46 -07:00
Fuheng Zhao aec0d044de support superpage withou modifying atomic update function 2021-08-03 11:17:14 -07:00
Steve Atherton c16b73bb2f Bug fix, BTreeCursor pager event reason was not being initialized. Changed metric column order. 2021-07-21 01:28:25 -07:00
Steve Atherton 01af706228 Refactor metric logging to be shorter and changed text format to be more condensed. 2021-07-20 21:23:50 -07:00
Steve Atherton 39eb71f54a Corrections in BTreeCursor event reasons, fixed by BTreeCursor now storing reason as a member because it's much simpler. Some other clang-format changes and a couple of renames. 2021-07-18 03:02:10 -07:00
Steve Atherton 09a8561606 Merge branch 'master' of github.com:apple/foundationdb into redwood-io-priority
# Conflicts:
#	fdbserver/IPager.h
#	fdbserver/VersionedBTree.actor.cpp
2021-07-18 01:49:36 -07:00
Steve Atherton 89140b0281 Fixed PagerEventReason for BTree writePages(). Renamed enums to start with capital letters to match one of the two styles used throughput the code base (CamelCase or ALLCAPS). 2021-07-17 03:44:00 -07:00
Fuheng Zhao d87e695fba format files 2021-07-16 14:02:59 -07:00
Fuheng Zhao 29d61b708f fix issues 2021-07-16 13:53:30 -07:00
Fuheng Zhao 1c7e3f08c2 format the files 2021-07-14 17:26:24 -07:00
Fuheng Zhao 126c87923f switch unitmapper to static arry 2021-07-14 16:31:13 -07:00
Fuheng Zhao 737f053a7c modify the reference 2021-07-13 10:10:23 -07:00
sfc-gh-fzhao 62ad629b44
fix comment typo
Co-authored-by: Steve Atherton <steve.atherton@snowflake.com>
2021-07-13 09:08:02 -07:00
Fuheng Zhao 79a2950b2f move static potential combination outside the struct 2021-07-12 21:18:06 -07:00
Fuheng Zhao 7dbe10617b format the code with devFormat 2021-07-12 16:07:18 -07:00
Fuheng Zhao 43e3e24bb7 resolve naming conflict 2021-07-11 14:11:30 -07:00
Fuheng Zhao 0104edb651 todo: raneg prefetch to leaf level, and format file 2021-07-11 14:09:48 -07:00
sfc-gh-fzhao 7935567f34
Update fdbserver/IPager.h
Co-authored-by: Steve Atherton <steve.atherton@snowflake.com>
2021-07-11 12:59:55 -07:00
Steve Atherton fe575b995a Added IO Priority to Redwood. 2021-07-09 05:05:08 -07:00
Fuheng Zhao fa5a408eb4 change trace message 2021-07-06 22:31:37 -07:00
Fuheng Zhao 069d52a3cf update trace information and fix minor errors 2021-07-06 22:31:37 -07:00
Fuheng Zhao 8ba2991263 check in idx 2021-07-06 22:31:37 -07:00
Fuheng Zhao 34cd0d04d7 update redwoodmetrics structure; need to fix bug 2021-07-06 22:31:37 -07:00
Fuheng Zhao 9d1aeb3e1e initial draft on RedWoodMetrics changes 2021-07-06 22:31:37 -07:00
Steve Atherton 23d27663c0 Merge commit '98e463d642d1e674983842c8b2925981ff849729' into redwood-deltatree2-master
# Conflicts:
#	fdbserver/IPager.h
#	fdbserver/Knobs.cpp
#	fdbserver/Knobs.h
#	fdbserver/VersionedBTree.actor.cpp
2021-06-09 01:31:16 -07:00
Steve Atherton 98e463d642
Merge pull request #4781 from sfc-gh-ngoyal/redwood_queue_improvements
Redwood queue format refactored to support faster cold start recovery of pager update log.
2021-06-09 00:11:57 -07:00
Steve Atherton adcf126bfa Removed commit read FlowLock because it costs too much overhead, will need another way to throttle. Removed readPage() fromCache argument as it is no longer useful. 2021-06-08 16:58:35 -07:00
Andrew Noyes a655ae3e48 Try not marking buffer undefined 2021-06-02 16:25:25 -07:00
negoyal c2c523d96f Address review comments. 2021-05-25 22:52:10 -07:00
negoyal b37fb2ed5e Merge branch 'master' into redwood_queue_improvements 2021-05-20 21:25:18 -07:00