Evan Tschannen
e8016aba7b
updated documentation for 6.2.9
2019-11-12 23:16:35 -08:00
Evan Tschannen
8f725db92e
serialization of logRangeMutation->second caused long slow tasks
2019-11-12 23:06:58 -08:00
Evan Tschannen
b1b5f88cb1
Merge pull request #2344 from bnamasivayam/release-6.2
...
Fix bug where DD or RK could be halted and re-recruited in a loop for…
2019-11-12 21:47:28 -08:00
Evan Tschannen
5e463f7290
Merge pull request #2342 from ajbeamon/packet-size-event-rename
...
Rename LargePacket warnings to distinguish between sent and received packets.
2019-11-12 20:42:55 -08:00
Evan Tschannen
be303cad7a
Merge pull request #2339 from etschannen/feature-increase-reboot-priority
...
Increase the priority of reboot and recruitment requests
2019-11-12 20:42:22 -08:00
Evan Tschannen
7ebbb4d9cf
Merge pull request #2337 from etschannen/feature-logrouter-peek
...
Do not limit log router peeking from satellite logs
2019-11-12 20:41:22 -08:00
Evan Tschannen
f7542f5022
Merge pull request #2348 from etschannen/feature-taskbucket-logging
...
added logging to TaskBucket
2019-11-12 20:40:51 -08:00
Balachandar Namasivayam
c26bb52979
Enable Consistency Checks for DD and RK.
2019-11-12 20:11:08 -08:00
Evan Tschannen
5fbd9f2ed5
added logging to TaskBucket
2019-11-12 19:15:56 -08:00
Balachandar Namasivayam
2e41497580
This commit tries to distribute RK and DD among other empty available processes.
2019-11-12 17:52:42 -08:00
Steve Atherton
17059596e9
Merge pull request #2346 from satherton/feature-redwood
...
Update Redwood
2019-11-12 16:25:10 -08:00
Balachandar Namasivayam
f5282f2c7e
Fix bug where DD or RK could be halted and re-recruited in a loop for certain valid process class configurations. Specifically, recruitment of DD or RK takes into account that master process is preferred over proxy, resolver or cc.
...
But check for better DD only looks for better machine class ignoring that the new recruit could share a proxy or resolver or CC. Also try to balance the distribution of the DD and RK role if there are enough processes to do so.
2019-11-12 14:22:36 -08:00
A.J. Beamon
ef801a6432
Rename LargePacket warnings to distinguish between sent and received packets. Also remove Net2_ prefix from packet size trace events.
2019-11-12 09:23:46 -08:00
Stephen Atherton
f841d14141
Bumped format versions, also simplified version scheme to a pager version and a btree version, removing per-page versions for queue and btree pages.
2019-11-11 16:28:21 -08:00
Evan Tschannen
1e5677b55a
increase the priority of reboot and recruitment requests
2019-11-11 15:17:11 -08:00
Stephen Atherton
9227de5c20
Redwood correctness unit test was using wallclock based time limit which breaks determinism.
2019-11-11 15:13:58 -08:00
Stephen Atherton
61558eea04
Implemented page preloading on BTree cursor seeks to enable hiding latency on soon-to-be-read sibling pages. Added random scans with various preload sizes to the set performance unit test. ObjectCache now tracks hits, misses, and pages which were preloaded but then never used prior to eviction. BTree pages no longer store flags because height is sufficient. Removed virtual specifier in classes not designed to be further inherited. Removed old prototype code (PrefixTree, IndirectShadowPager, MemoryPager) as some interface changes are incompatible and they are no longer worth maintaining.
2019-11-11 09:54:22 -08:00
Evan Tschannen
396dccbc98
when peeking from satellites we do not need to limit the amount of peeking on log router tags, because that is the only thing that can be peeked from a satellite log
2019-11-08 18:34:05 -08:00
Steve Atherton
d76070e37d
Merge pull request #2331 from satherton/feature-redwood
...
Update redwood
2019-11-08 10:38:16 -08:00
Stephen Atherton
2aa672cb59
When bulk building pages, make most of them full.
2019-11-07 15:52:23 -08:00
Stephen Atherton
5d00d93665
Fixed errors found by valgrind involving incorrect page memory lifetimes for IO operations plus some false positives for partially used pages.
2019-11-07 13:57:09 -08:00
Evan Tschannen
fd5c57d4e3
Merge pull request #2326 from etschannen/post-release-cleanup-6.2.8
...
Post release cleanup 6.2.8
2019-11-06 13:24:48 -08:00
Evan Tschannen
86abb0d467
updated cmake for 6.2.9
2019-11-06 13:12:30 -08:00
Evan Tschannen
e660149042
update installer WIX GUID following release
2019-11-06 13:09:57 -08:00
Evan Tschannen
7b8f1df3b6
update versions target to 6.2.9
2019-11-06 13:09:57 -08:00
Evan Tschannen
a11db961cd
Merge pull request #2323 from etschannen/feature-efficient-buffered-cursor
...
remote logs use bufferedCursor when peeking from log routers
2019-11-05 20:45:15 -08:00
Evan Tschannen
dbc5a2393c
combineMessages still did not serialize tags correctly
2019-11-05 18:44:30 -08:00
Evan Tschannen
1c873591be
fixed a compiler error
2019-11-05 18:32:15 -08:00
Evan Tschannen
86560fe727
fix: tempTags was not used correctly
2019-11-05 18:22:25 -08:00
Evan Tschannen
a8ca47beff
optimized memory allocations by using VectorRef<Tag> instead of std::vector<Tag>
2019-11-05 18:07:30 -08:00
Evan Tschannen
4a597fdcce
increase the task priority of popping
2019-11-05 15:03:41 -08:00
Stephen Atherton
b50d26c4da
KVStoreTest now runs sqlite and redwood tests.
2019-11-05 13:46:04 -08:00
Stephen Atherton
ea428b72f5
Bug fix, DWALPager must flush its page ID queues in order to get an accurate user page count.
2019-11-05 01:11:34 -08:00
Evan Tschannen
96c79057a2
Merge pull request #2324 from etschannen/prepare-release-6.2.8
...
update installer WIX GUID following release
2019-11-04 20:40:18 -08:00
Evan Tschannen
f84c2667f0
update installer WIX GUID following release
2019-11-04 20:39:37 -08:00
Evan Tschannen
cb65641115
updated downloads for 6.2.8
2019-11-04 20:25:49 -08:00
Evan Tschannen
daac8a2c22
Knobified a few variables
2019-11-04 20:21:38 -08:00
Evan Tschannen
457896b80d
remote logs use bufferedCursor when peeking from log routers to improve performance
...
bufferedCursor performance has been improved
2019-11-04 19:47:45 -08:00
Evan Tschannen
3728ef996e
Merge pull request #2318 from satherton/feature-redwood
...
Redwood update
2019-11-04 15:14:17 -08:00
Stephen Atherton
0c95fef8aa
Bug fix in tree clear and size check where sometimes there could still be old versions of pages in use because not enough commits have passed for them to be rolled off and freed.
2019-11-04 12:59:57 -08:00
Stephen Atherton
4e9c3164a8
COWPager can now internally remap page IDs by version and has been renamed to DWALPager. This causes the B+Tree to no longer have to rewrite all ancestors of an updated page. FIFOQueue now has a read-only cursor and a peekAll() method to read an entire queue without popping it. Fixed some valgrind false positives, made some debug logging improvements. Fixed bug in pager shutdown where it could wait on an ActorCollection containing canceled futures.
2019-11-04 03:04:03 -08:00
Evan Tschannen
c805ed11e8
Merge pull request #2307 from etschannen/feature-enable-parallel-peek
...
Parallel peeking was not enabled when fetching from log routers
2019-11-01 15:39:00 -07:00
Evan Tschannen
f4143c4f50
updated release notes
2019-11-01 14:07:01 -07:00
Evan Tschannen
8a3521f945
Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-enable-parallel-peek
2019-11-01 14:04:22 -07:00
Evan Tschannen
85c315f684
Fix: parallelPeekMore was not enabled when peeking from log routers
2019-11-01 14:02:44 -07:00
A.J. Beamon
1dc5985062
Merge pull request #2305 from etschannen/release-6.2
...
merges crossing systemKeys.begin did not decrement systemSizeEstimate
2019-11-01 09:12:01 -07:00
Evan Tschannen
7f75eca7cb
updated release notes
2019-10-31 17:06:58 -07:00
Evan Tschannen
8f0348d5e0
fix: merges which cross over systemKeys.begin did not properly decrement the systemSizeEstimate
2019-10-31 16:38:33 -07:00
Evan Tschannen
5f6204b550
Merge pull request #2303 from ajbeamon/cleanup-cleanup-command
...
Cleanup the fdbbackup cleanup command output
2019-10-31 10:19:28 -07:00
A.J. Beamon
f175ed30b3
Cleanup the fdbbackup cleanup command output. Add cleanup to the usage output printed for fdbbackup.
2019-10-31 09:52:21 -07:00