Commit Graph

6874 Commits

Author SHA1 Message Date
Evan Tschannen e8016aba7b updated documentation for 6.2.9 2019-11-12 23:16:35 -08:00
Evan Tschannen 8f725db92e serialization of logRangeMutation->second caused long slow tasks 2019-11-12 23:06:58 -08:00
Evan Tschannen b1b5f88cb1
Merge pull request #2344 from bnamasivayam/release-6.2
Fix bug where DD or RK could be halted and re-recruited in a loop for…
2019-11-12 21:47:28 -08:00
Evan Tschannen 5e463f7290
Merge pull request #2342 from ajbeamon/packet-size-event-rename
Rename LargePacket warnings to distinguish between sent and received packets.
2019-11-12 20:42:55 -08:00
Evan Tschannen be303cad7a
Merge pull request #2339 from etschannen/feature-increase-reboot-priority
Increase the priority of reboot and recruitment requests
2019-11-12 20:42:22 -08:00
Evan Tschannen 7ebbb4d9cf
Merge pull request #2337 from etschannen/feature-logrouter-peek
Do not limit log router peeking from satellite logs
2019-11-12 20:41:22 -08:00
Evan Tschannen f7542f5022
Merge pull request #2348 from etschannen/feature-taskbucket-logging
added logging to TaskBucket
2019-11-12 20:40:51 -08:00
Balachandar Namasivayam c26bb52979 Enable Consistency Checks for DD and RK. 2019-11-12 20:11:08 -08:00
Evan Tschannen 5fbd9f2ed5 added logging to TaskBucket 2019-11-12 19:15:56 -08:00
Balachandar Namasivayam 2e41497580 This commit tries to distribute RK and DD among other empty available processes. 2019-11-12 17:52:42 -08:00
Steve Atherton 17059596e9
Merge pull request #2346 from satherton/feature-redwood
Update Redwood
2019-11-12 16:25:10 -08:00
Balachandar Namasivayam f5282f2c7e Fix bug where DD or RK could be halted and re-recruited in a loop for certain valid process class configurations. Specifically, recruitment of DD or RK takes into account that master process is preferred over proxy, resolver or cc.
But check for better DD only looks for better machine class ignoring that the new recruit could share a proxy or resolver or CC. Also try to balance the distribution of the DD and RK role if there are enough processes to do so.
2019-11-12 14:22:36 -08:00
A.J. Beamon ef801a6432 Rename LargePacket warnings to distinguish between sent and received packets. Also remove Net2_ prefix from packet size trace events. 2019-11-12 09:23:46 -08:00
Stephen Atherton f841d14141 Bumped format versions, also simplified version scheme to a pager version and a btree version, removing per-page versions for queue and btree pages. 2019-11-11 16:28:21 -08:00
Evan Tschannen 1e5677b55a increase the priority of reboot and recruitment requests 2019-11-11 15:17:11 -08:00
Stephen Atherton 9227de5c20 Redwood correctness unit test was using wallclock based time limit which breaks determinism. 2019-11-11 15:13:58 -08:00
Stephen Atherton 61558eea04 Implemented page preloading on BTree cursor seeks to enable hiding latency on soon-to-be-read sibling pages. Added random scans with various preload sizes to the set performance unit test. ObjectCache now tracks hits, misses, and pages which were preloaded but then never used prior to eviction. BTree pages no longer store flags because height is sufficient. Removed virtual specifier in classes not designed to be further inherited. Removed old prototype code (PrefixTree, IndirectShadowPager, MemoryPager) as some interface changes are incompatible and they are no longer worth maintaining. 2019-11-11 09:54:22 -08:00
Evan Tschannen 396dccbc98 when peeking from satellites we do not need to limit the amount of peeking on log router tags, because that is the only thing that can be peeked from a satellite log 2019-11-08 18:34:05 -08:00
Steve Atherton d76070e37d
Merge pull request #2331 from satherton/feature-redwood
Update redwood
2019-11-08 10:38:16 -08:00
Stephen Atherton 2aa672cb59 When bulk building pages, make most of them full. 2019-11-07 15:52:23 -08:00
Stephen Atherton 5d00d93665 Fixed errors found by valgrind involving incorrect page memory lifetimes for IO operations plus some false positives for partially used pages. 2019-11-07 13:57:09 -08:00
Evan Tschannen fd5c57d4e3
Merge pull request #2326 from etschannen/post-release-cleanup-6.2.8
Post release cleanup 6.2.8
2019-11-06 13:24:48 -08:00
Evan Tschannen 86abb0d467 updated cmake for 6.2.9 2019-11-06 13:12:30 -08:00
Evan Tschannen e660149042 update installer WIX GUID following release 2019-11-06 13:09:57 -08:00
Evan Tschannen 7b8f1df3b6 update versions target to 6.2.9 2019-11-06 13:09:57 -08:00
Evan Tschannen a11db961cd
Merge pull request #2323 from etschannen/feature-efficient-buffered-cursor
remote logs use bufferedCursor when peeking from log routers
2019-11-05 20:45:15 -08:00
Evan Tschannen dbc5a2393c combineMessages still did not serialize tags correctly 2019-11-05 18:44:30 -08:00
Evan Tschannen 1c873591be fixed a compiler error 2019-11-05 18:32:15 -08:00
Evan Tschannen 86560fe727 fix: tempTags was not used correctly 2019-11-05 18:22:25 -08:00
Evan Tschannen a8ca47beff optimized memory allocations by using VectorRef<Tag> instead of std::vector<Tag> 2019-11-05 18:07:30 -08:00
Evan Tschannen 4a597fdcce increase the task priority of popping 2019-11-05 15:03:41 -08:00
Stephen Atherton b50d26c4da KVStoreTest now runs sqlite and redwood tests. 2019-11-05 13:46:04 -08:00
Stephen Atherton ea428b72f5 Bug fix, DWALPager must flush its page ID queues in order to get an accurate user page count. 2019-11-05 01:11:34 -08:00
Evan Tschannen 96c79057a2
Merge pull request #2324 from etschannen/prepare-release-6.2.8
update installer WIX GUID following release
2019-11-04 20:40:18 -08:00
Evan Tschannen f84c2667f0 update installer WIX GUID following release 2019-11-04 20:39:37 -08:00
Evan Tschannen cb65641115 updated downloads for 6.2.8 2019-11-04 20:25:49 -08:00
Evan Tschannen daac8a2c22 Knobified a few variables 2019-11-04 20:21:38 -08:00
Evan Tschannen 457896b80d remote logs use bufferedCursor when peeking from log routers to improve performance
bufferedCursor performance has been improved
2019-11-04 19:47:45 -08:00
Evan Tschannen 3728ef996e
Merge pull request #2318 from satherton/feature-redwood
Redwood update
2019-11-04 15:14:17 -08:00
Stephen Atherton 0c95fef8aa Bug fix in tree clear and size check where sometimes there could still be old versions of pages in use because not enough commits have passed for them to be rolled off and freed. 2019-11-04 12:59:57 -08:00
Stephen Atherton 4e9c3164a8 COWPager can now internally remap page IDs by version and has been renamed to DWALPager. This causes the B+Tree to no longer have to rewrite all ancestors of an updated page. FIFOQueue now has a read-only cursor and a peekAll() method to read an entire queue without popping it. Fixed some valgrind false positives, made some debug logging improvements. Fixed bug in pager shutdown where it could wait on an ActorCollection containing canceled futures. 2019-11-04 03:04:03 -08:00
Evan Tschannen c805ed11e8
Merge pull request #2307 from etschannen/feature-enable-parallel-peek
Parallel peeking was not enabled when fetching from log routers
2019-11-01 15:39:00 -07:00
Evan Tschannen f4143c4f50 updated release notes 2019-11-01 14:07:01 -07:00
Evan Tschannen 8a3521f945 Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-enable-parallel-peek 2019-11-01 14:04:22 -07:00
Evan Tschannen 85c315f684 Fix: parallelPeekMore was not enabled when peeking from log routers 2019-11-01 14:02:44 -07:00
A.J. Beamon 1dc5985062
Merge pull request #2305 from etschannen/release-6.2
merges crossing systemKeys.begin did not decrement systemSizeEstimate
2019-11-01 09:12:01 -07:00
Evan Tschannen 7f75eca7cb updated release notes 2019-10-31 17:06:58 -07:00
Evan Tschannen 8f0348d5e0 fix: merges which cross over systemKeys.begin did not properly decrement the systemSizeEstimate 2019-10-31 16:38:33 -07:00
Evan Tschannen 5f6204b550
Merge pull request #2303 from ajbeamon/cleanup-cleanup-command
Cleanup the fdbbackup cleanup command output
2019-10-31 10:19:28 -07:00
A.J. Beamon f175ed30b3 Cleanup the fdbbackup cleanup command output. Add cleanup to the usage output printed for fdbbackup. 2019-10-31 09:52:21 -07:00