7ebbb4d9cf
Merge pull request #2337 from etschannen/feature-logrouter-peek
...
Do not limit log router peeking from satellite logs
2019-11-12 20:41:22 -08:00
f7542f5022
Merge pull request #2348 from etschannen/feature-taskbucket-logging
...
added logging to TaskBucket
2019-11-12 20:40:51 -08:00
c26bb52979
Enable Consistency Checks for DD and RK.
2019-11-12 20:11:08 -08:00
5fbd9f2ed5
added logging to TaskBucket
2019-11-12 19:15:56 -08:00
2e41497580
This commit tries to distribute RK and DD among other empty available processes.
2019-11-12 17:52:42 -08:00
17059596e9
Merge pull request #2346 from satherton/feature-redwood
...
Update Redwood
2019-11-12 16:25:10 -08:00
f5282f2c7e
Fix bug where DD or RK could be halted and re-recruited in a loop for certain valid process class configurations. Specifically, recruitment of DD or RK takes into account that master process is preferred over proxy, resolver or cc.
...
But check for better DD only looks for better machine class ignoring that the new recruit could share a proxy or resolver or CC. Also try to balance the distribution of the DD and RK role if there are enough processes to do so.
2019-11-12 14:22:36 -08:00
ef801a6432
Rename LargePacket warnings to distinguish between sent and received packets. Also remove Net2_ prefix from packet size trace events.
2019-11-12 09:23:46 -08:00
f841d14141
Bumped format versions, also simplified version scheme to a pager version and a btree version, removing per-page versions for queue and btree pages.
2019-11-11 16:28:21 -08:00
1e5677b55a
increase the priority of reboot and recruitment requests
2019-11-11 15:17:11 -08:00
9227de5c20
Redwood correctness unit test was using wallclock based time limit which breaks determinism.
2019-11-11 15:13:58 -08:00
61558eea04
Implemented page preloading on BTree cursor seeks to enable hiding latency on soon-to-be-read sibling pages. Added random scans with various preload sizes to the set performance unit test. ObjectCache now tracks hits, misses, and pages which were preloaded but then never used prior to eviction. BTree pages no longer store flags because height is sufficient. Removed virtual specifier in classes not designed to be further inherited. Removed old prototype code (PrefixTree, IndirectShadowPager, MemoryPager) as some interface changes are incompatible and they are no longer worth maintaining.
2019-11-11 09:54:22 -08:00
396dccbc98
when peeking from satellites we do not need to limit the amount of peeking on log router tags, because that is the only thing that can be peeked from a satellite log
2019-11-08 18:34:05 -08:00
d76070e37d
Merge pull request #2331 from satherton/feature-redwood
...
Update redwood
2019-11-08 10:38:16 -08:00
2aa672cb59
When bulk building pages, make most of them full.
2019-11-07 15:52:23 -08:00
5d00d93665
Fixed errors found by valgrind involving incorrect page memory lifetimes for IO operations plus some false positives for partially used pages.
2019-11-07 13:57:09 -08:00
fd5c57d4e3
Merge pull request #2326 from etschannen/post-release-cleanup-6.2.8
...
Post release cleanup 6.2.8
2019-11-06 13:24:48 -08:00
86abb0d467
updated cmake for 6.2.9
2019-11-06 13:12:30 -08:00
e660149042
update installer WIX GUID following release
2019-11-06 13:09:57 -08:00
7b8f1df3b6
update versions target to 6.2.9
2019-11-06 13:09:57 -08:00
a11db961cd
Merge pull request #2323 from etschannen/feature-efficient-buffered-cursor
...
remote logs use bufferedCursor when peeking from log routers
2019-11-05 20:45:15 -08:00
dbc5a2393c
combineMessages still did not serialize tags correctly
2019-11-05 18:44:30 -08:00
1c873591be
fixed a compiler error
2019-11-05 18:32:15 -08:00
86560fe727
fix: tempTags was not used correctly
2019-11-05 18:22:25 -08:00
a8ca47beff
optimized memory allocations by using VectorRef<Tag> instead of std::vector<Tag>
2019-11-05 18:07:30 -08:00
4a597fdcce
increase the task priority of popping
2019-11-05 15:03:41 -08:00
b50d26c4da
KVStoreTest now runs sqlite and redwood tests.
2019-11-05 13:46:04 -08:00
ea428b72f5
Bug fix, DWALPager must flush its page ID queues in order to get an accurate user page count.
2019-11-05 01:11:34 -08:00
96c79057a2
Merge pull request #2324 from etschannen/prepare-release-6.2.8
...
update installer WIX GUID following release
2019-11-04 20:40:18 -08:00
f84c2667f0
update installer WIX GUID following release
2019-11-04 20:39:37 -08:00
cb65641115
updated downloads for 6.2.8
2019-11-04 20:25:49 -08:00
daac8a2c22
Knobified a few variables
2019-11-04 20:21:38 -08:00
457896b80d
remote logs use bufferedCursor when peeking from log routers to improve performance
...
bufferedCursor performance has been improved
2019-11-04 19:47:45 -08:00
3728ef996e
Merge pull request #2318 from satherton/feature-redwood
...
Redwood update
2019-11-04 15:14:17 -08:00
0c95fef8aa
Bug fix in tree clear and size check where sometimes there could still be old versions of pages in use because not enough commits have passed for them to be rolled off and freed.
2019-11-04 12:59:57 -08:00
4e9c3164a8
COWPager can now internally remap page IDs by version and has been renamed to DWALPager. This causes the B+Tree to no longer have to rewrite all ancestors of an updated page. FIFOQueue now has a read-only cursor and a peekAll() method to read an entire queue without popping it. Fixed some valgrind false positives, made some debug logging improvements. Fixed bug in pager shutdown where it could wait on an ActorCollection containing canceled futures.
2019-11-04 03:04:03 -08:00
c805ed11e8
Merge pull request #2307 from etschannen/feature-enable-parallel-peek
...
Parallel peeking was not enabled when fetching from log routers
2019-11-01 15:39:00 -07:00
f4143c4f50
updated release notes
2019-11-01 14:07:01 -07:00
8a3521f945
Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-enable-parallel-peek
2019-11-01 14:04:22 -07:00
85c315f684
Fix: parallelPeekMore was not enabled when peeking from log routers
2019-11-01 14:02:44 -07:00
1dc5985062
Merge pull request #2305 from etschannen/release-6.2
...
merges crossing systemKeys.begin did not decrement systemSizeEstimate
2019-11-01 09:12:01 -07:00
7f75eca7cb
updated release notes
2019-10-31 17:06:58 -07:00
8f0348d5e0
fix: merges which cross over systemKeys.begin did not properly decrement the systemSizeEstimate
2019-10-31 16:38:33 -07:00
5f6204b550
Merge pull request #2303 from ajbeamon/cleanup-cleanup-command
...
Cleanup the fdbbackup cleanup command output
2019-10-31 10:19:28 -07:00
f175ed30b3
Cleanup the fdbbackup cleanup command output. Add cleanup to the usage output printed for fdbbackup.
2019-10-31 09:52:21 -07:00
547616d5f1
Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-redwood
2019-10-29 16:33:22 -07:00
9c0d671d07
Two bug fixes in Redwood related to split KV pairs and one was masking the other. The first bug resulted in an incomplete erasure of fragments for a split KV pair and the second bug would generate an unnecessary explicit null record for the same key which would cause reads to correctly see the key as missing. Redwood correctness test now clears the tree and verifies expected resulting pager footprint, which succeeds due to the bug fixes.
2019-10-29 01:31:59 -07:00
40d53e23f5
Optimization, only the first btree mutation boundary for a subtree needs to be compared to the subtree's lower bound. Also removed a check for a condition which is no longer possible due to other changes.
2019-10-28 16:05:11 -07:00
0d993522d3
CommitSubtree() will now return an empty page set even for the tree root because commit_impl() handles this correctly. Improved commitSubtree() debug output related to which mutations are relevant to a subtree. Added random setting of range clear boundaries after clear() in Redwood correctness to make sure mutation buffer logic handles this correctly. B+Tree's dbEnd mutation is represented as a clear to prevent unnecessary rightmost subtree traversal during commit.
2019-10-28 04:00:37 -07:00
5cf0045bc0
Merge pull request #2294 from satherton/feature-redwood
...
Bug fixes in Redwood
2019-10-25 14:56:01 -07:00
Evan Tschannen