Commit Graph

7154 Commits

Author SHA1 Message Date
Stephen Atherton 5d00d93665 Fixed errors found by valgrind involving incorrect page memory lifetimes for IO operations plus some false positives for partially used pages. 2019-11-07 13:57:09 -08:00
Evan Tschannen fd5c57d4e3
Merge pull request #2326 from etschannen/post-release-cleanup-6.2.8
Post release cleanup 6.2.8
2019-11-06 13:24:48 -08:00
Evan Tschannen 86abb0d467 updated cmake for 6.2.9 2019-11-06 13:12:30 -08:00
Evan Tschannen e660149042 update installer WIX GUID following release 2019-11-06 13:09:57 -08:00
Evan Tschannen 7b8f1df3b6 update versions target to 6.2.9 2019-11-06 13:09:57 -08:00
Evan Tschannen a11db961cd
Merge pull request #2323 from etschannen/feature-efficient-buffered-cursor
remote logs use bufferedCursor when peeking from log routers
2019-11-05 20:45:15 -08:00
Evan Tschannen dbc5a2393c combineMessages still did not serialize tags correctly 2019-11-05 18:44:30 -08:00
Evan Tschannen 1c873591be fixed a compiler error 2019-11-05 18:32:15 -08:00
Evan Tschannen 86560fe727 fix: tempTags was not used correctly 2019-11-05 18:22:25 -08:00
Evan Tschannen a8ca47beff optimized memory allocations by using VectorRef<Tag> instead of std::vector<Tag> 2019-11-05 18:07:30 -08:00
Evan Tschannen 4a597fdcce increase the task priority of popping 2019-11-05 15:03:41 -08:00
Stephen Atherton b50d26c4da KVStoreTest now runs sqlite and redwood tests. 2019-11-05 13:46:04 -08:00
Stephen Atherton ea428b72f5 Bug fix, DWALPager must flush its page ID queues in order to get an accurate user page count. 2019-11-05 01:11:34 -08:00
Evan Tschannen 96c79057a2
Merge pull request #2324 from etschannen/prepare-release-6.2.8
update installer WIX GUID following release
2019-11-04 20:40:18 -08:00
Evan Tschannen f84c2667f0 update installer WIX GUID following release 2019-11-04 20:39:37 -08:00
Evan Tschannen cb65641115 updated downloads for 6.2.8 2019-11-04 20:25:49 -08:00
Evan Tschannen daac8a2c22 Knobified a few variables 2019-11-04 20:21:38 -08:00
Evan Tschannen 457896b80d remote logs use bufferedCursor when peeking from log routers to improve performance
bufferedCursor performance has been improved
2019-11-04 19:47:45 -08:00
Evan Tschannen 3728ef996e
Merge pull request #2318 from satherton/feature-redwood
Redwood update
2019-11-04 15:14:17 -08:00
Stephen Atherton 0c95fef8aa Bug fix in tree clear and size check where sometimes there could still be old versions of pages in use because not enough commits have passed for them to be rolled off and freed. 2019-11-04 12:59:57 -08:00
Stephen Atherton 4e9c3164a8 COWPager can now internally remap page IDs by version and has been renamed to DWALPager. This causes the B+Tree to no longer have to rewrite all ancestors of an updated page. FIFOQueue now has a read-only cursor and a peekAll() method to read an entire queue without popping it. Fixed some valgrind false positives, made some debug logging improvements. Fixed bug in pager shutdown where it could wait on an ActorCollection containing canceled futures. 2019-11-04 03:04:03 -08:00
Evan Tschannen c805ed11e8
Merge pull request #2307 from etschannen/feature-enable-parallel-peek
Parallel peeking was not enabled when fetching from log routers
2019-11-01 15:39:00 -07:00
Evan Tschannen f4143c4f50 updated release notes 2019-11-01 14:07:01 -07:00
Evan Tschannen 8a3521f945 Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-enable-parallel-peek 2019-11-01 14:04:22 -07:00
Evan Tschannen 85c315f684 Fix: parallelPeekMore was not enabled when peeking from log routers 2019-11-01 14:02:44 -07:00
A.J. Beamon 1dc5985062
Merge pull request #2305 from etschannen/release-6.2
merges crossing systemKeys.begin did not decrement systemSizeEstimate
2019-11-01 09:12:01 -07:00
Evan Tschannen 7f75eca7cb updated release notes 2019-10-31 17:06:58 -07:00
Evan Tschannen 8f0348d5e0 fix: merges which cross over systemKeys.begin did not properly decrement the systemSizeEstimate 2019-10-31 16:38:33 -07:00
Evan Tschannen 5f6204b550
Merge pull request #2303 from ajbeamon/cleanup-cleanup-command
Cleanup the fdbbackup cleanup command output
2019-10-31 10:19:28 -07:00
A.J. Beamon f175ed30b3 Cleanup the fdbbackup cleanup command output. Add cleanup to the usage output printed for fdbbackup. 2019-10-31 09:52:21 -07:00
Stephen Atherton 547616d5f1 Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-redwood 2019-10-29 16:33:22 -07:00
Stephen Atherton 9c0d671d07 Two bug fixes in Redwood related to split KV pairs and one was masking the other. The first bug resulted in an incomplete erasure of fragments for a split KV pair and the second bug would generate an unnecessary explicit null record for the same key which would cause reads to correctly see the key as missing. Redwood correctness test now clears the tree and verifies expected resulting pager footprint, which succeeds due to the bug fixes. 2019-10-29 01:31:59 -07:00
Stephen Atherton 40d53e23f5 Optimization, only the first btree mutation boundary for a subtree needs to be compared to the subtree's lower bound. Also removed a check for a condition which is no longer possible due to other changes. 2019-10-28 16:05:11 -07:00
Stephen Atherton 0d993522d3 CommitSubtree() will now return an empty page set even for the tree root because commit_impl() handles this correctly. Improved commitSubtree() debug output related to which mutations are relevant to a subtree. Added random setting of range clear boundaries after clear() in Redwood correctness to make sure mutation buffer logic handles this correctly. B+Tree's dbEnd mutation is represented as a clear to prevent unnecessary rightmost subtree traversal during commit. 2019-10-28 04:00:37 -07:00
Evan Tschannen 5cf0045bc0
Merge pull request #2294 from satherton/feature-redwood
Bug fixes in Redwood
2019-10-25 14:56:01 -07:00
Stephen Atherton 2ee1782c19 Bug fixes in Redwood. BTree height was not being reset when a new empty root is written. IKeyValueStore wrapper was not obeying the row limit in a reverse range query. Added yields to and delays to break up tasks and set IO priorities. 2019-10-25 14:52:06 -07:00
Evan Tschannen 1d26ca4aa7
Merge pull request #2293 from etschannen/release-6.2
fixed Javadoc headings
2019-10-25 13:40:16 -07:00
Evan Tschannen 0953bf376d fixed Javadoc headings 2019-10-25 13:38:04 -07:00
Evan Tschannen fc9497be33
Merge pull request #2291 from etschannen/post-release-cleanup-6.2.7
Post release cleanup 6.2.7
2019-10-24 17:06:06 -07:00
Evan Tschannen fdb0bcdfbc update cmake to 6.2.8 2019-10-24 17:05:45 -07:00
Evan Tschannen 9682528372 update installer WIX GUID following release 2019-10-24 17:02:56 -07:00
Evan Tschannen acbfc70373 update versions target to 6.2.8 2019-10-24 17:02:56 -07:00
Evan Tschannen d3c4bd9c5a
Merge pull request #2289 from mpilman/eio_odirect_mt
Use O_DIRECT with EIO and option to control concurrency
2019-10-24 15:19:48 -07:00
mpilman 92ce9ef5dc updated comment 2019-10-24 11:45:32 -07:00
mpilman 325a8e4213 remove confusing USE_ODIRECT knob 2019-10-24 11:44:03 -07:00
mpilman f23392ec5a Don't use O_DIRECT in EIO by default 2019-10-24 11:39:55 -07:00
mpilman 7ad0e20e48 Added knob to disable O_DIRECT 2019-10-24 11:20:14 -07:00
mpilman f41f19b5f6 Introduced knob to set eio parallelism 2019-10-24 11:20:14 -07:00
mpilman 85977fb8d5 Use O_DIRECT with EIO 2019-10-24 11:20:14 -07:00
Evan Tschannen f640aec1b6
Merge pull request #2288 from etschannen/release-6.2
updated release notes
2019-10-24 10:10:26 -07:00