Commit Graph

7019 Commits

Author SHA1 Message Date
Stephen Atherton 2ee1782c19 Bug fixes in Redwood. BTree height was not being reset when a new empty root is written. IKeyValueStore wrapper was not obeying the row limit in a reverse range query. Added yields to and delays to break up tasks and set IO priorities. 2019-10-25 14:52:06 -07:00
Evan Tschannen 1d26ca4aa7
Merge pull request #2293 from etschannen/release-6.2
fixed Javadoc headings
2019-10-25 13:40:16 -07:00
Evan Tschannen 0953bf376d fixed Javadoc headings 2019-10-25 13:38:04 -07:00
Evan Tschannen fc9497be33
Merge pull request #2291 from etschannen/post-release-cleanup-6.2.7
Post release cleanup 6.2.7
2019-10-24 17:06:06 -07:00
Evan Tschannen fdb0bcdfbc update cmake to 6.2.8 2019-10-24 17:05:45 -07:00
Evan Tschannen 9682528372 update installer WIX GUID following release 2019-10-24 17:02:56 -07:00
Evan Tschannen acbfc70373 update versions target to 6.2.8 2019-10-24 17:02:56 -07:00
Evan Tschannen d3c4bd9c5a
Merge pull request #2289 from mpilman/eio_odirect_mt
Use O_DIRECT with EIO and option to control concurrency
2019-10-24 15:19:48 -07:00
mpilman 92ce9ef5dc updated comment 2019-10-24 11:45:32 -07:00
mpilman 325a8e4213 remove confusing USE_ODIRECT knob 2019-10-24 11:44:03 -07:00
mpilman f23392ec5a Don't use O_DIRECT in EIO by default 2019-10-24 11:39:55 -07:00
mpilman 7ad0e20e48 Added knob to disable O_DIRECT 2019-10-24 11:20:14 -07:00
mpilman f41f19b5f6 Introduced knob to set eio parallelism 2019-10-24 11:20:14 -07:00
mpilman 85977fb8d5 Use O_DIRECT with EIO 2019-10-24 11:20:14 -07:00
Evan Tschannen f640aec1b6
Merge pull request #2288 from etschannen/release-6.2
updated release notes
2019-10-24 10:10:26 -07:00
Evan Tschannen 7579bc7e7e updated release notes 2019-10-24 10:09:37 -07:00
Evan Tschannen a2bc4173a4
Merge pull request #2286 from etschannen/feature-immediate-undesired
Two bug fixes
2019-10-24 10:02:44 -07:00
Evan Tschannen a7492aab0a fix: poppedVersion can update during a yield, so all work must be done immediately after getMore returns 2019-10-23 23:06:02 -07:00
Evan Tschannen f8e44d2f71 fix: If a storage server was offline, it would not be checked for being in an undesired dc 2019-10-23 23:04:39 -07:00
Evan Tschannen afb3cb7455
Merge pull request #2284 from etschannen/release-6.2
Fixed a window build error
2019-10-23 13:49:18 -07:00
Evan Tschannen eb910b850b fixed a window build error 2019-10-23 13:48:24 -07:00
Evan Tschannen f90cb61e20
Merge pull request #2283 from etschannen/prepare-release-6.2.7
update installer WIX GUID following release
2019-10-23 11:55:45 -07:00
Evan Tschannen fc31c8dafa update installer WIX GUID following release 2019-10-23 11:55:04 -07:00
Evan Tschannen ec2070a8f7
Merge pull request #2282 from etschannen/release-6.2
Prepare for release 6.2.7
2019-10-23 11:52:19 -07:00
Evan Tschannen 2f6b661b51 updated documentation for 6.2.7 2019-10-23 11:17:53 -07:00
Evan Tschannen 2722c8b188 avoid starting a new startSpillingActor with every TLog recruitment 2019-10-23 11:15:54 -07:00
Evan Tschannen ae3f8132a7
Merge pull request #2280 from satherton/feature-redwood
Update redwood
2019-10-23 10:57:38 -07:00
Evan Tschannen 9197b03122
Merge pull request #2279 from ajbeamon/latency-band-ignore-batch
Ignore batch priority GRVs for latency band tracking
2019-10-23 10:52:44 -07:00
Evan Tschannen e01e8371a6
Merge pull request #2256 from alexmiller-apple/spill-log-on-switch-6.2
Spill SharedTLog when there's more than one
2019-10-23 10:51:28 -07:00
Evan Tschannen c1731e3b8d
Merge pull request #2276 from alexmiller-apple/fix-10min-stall-again-6.2
More fixes to prevent 10min stalls in recovering secondaries
2019-10-23 10:45:55 -07:00
A.J. Beamon 84bd55caa3 Add release note 2019-10-23 10:41:09 -07:00
A.J. Beamon a1bed51d34 Ignore batch priority GRVs for latency band tracking 2019-10-23 10:29:58 -07:00
Stephen Atherton 0e51a248b4 Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-redwood 2019-10-23 10:12:54 -07:00
Stephen Atherton 613bbaecc4 Bug fix in queue page footprint tracking. Added VersionedBTree::destroyAndCheckSanity() which clears the tree, processes the entire lazy delete queue, and then verifies some pager usage statistics. This check is currently disabled because it appears to find a bug where the final state has a few more pages in use than expected. StorageBytes now includes the delayed free list pages as free space since they will be reusable soon. 2019-10-23 09:31:06 -07:00
Alex Miller 0c325c5351 Always check which SharedTLog is active
In case it is set before we get to the onChange()
2019-10-23 01:59:36 -07:00
Alex Miller 1e5b8c74e3 Continuing a parallel peek after a timeout would hang.
This is to guard against the case where

1. Peeks with sequence numbers 0-39 are submitted
2. A 15min pause happens, in which timeout removes the peek tracker data
3. Peeks with sequence numbers 40-59 are submitted, with the same peekId

The second round of peeks wouldn't have the data left that it's allowed
to start running peek 40 immediately, and thus would hang for 10min
until it gets cleaned up.

Also, guard against overflowing the sequence number.
2019-10-22 19:24:05 -07:00
Evan Tschannen f65f0cd37a
Merge pull request #2274 from etschannen/feature-cleanup-destuidlookup
Automatically cleanup backup and DR sharing metadata
2019-10-22 19:11:23 -07:00
Alex Miller c008e7f8b3 When switching parallel->single->parallel, reset sequence and peekId
This fixes an issue where one could hang for 10min for the second
parallel peek to time out, if one happened to catch the edge of a
onlySpilled transition wrong.
2019-10-22 19:10:58 -07:00
Evan Tschannen 3bebcca846
Merge pull request #2266 from mpilman/bugfixes/catalina
Fix compiler errors on Catalina
2019-10-22 19:09:49 -07:00
Evan Tschannen 15f82a2295
Merge pull request #2270 from etschannen/feature-limit-updates
Limit the number of simultaneous committed version updates
2019-10-22 19:09:28 -07:00
Stephen Atherton 6a57fab431 Bug fixes in lazy subtree deletion, queue pushFront(), queue flush(), and advancing the oldest pager version. CommitSubtree no longer forces page rewrites due to boundary changes. IPager2 and IVersionedStore now have explicit async init() functions to avoid returning futures from some frequently used functions. 2019-10-22 17:17:29 -07:00
Evan Tschannen 35ac0071a8 fixed a compiler error 2019-10-22 17:06:54 -07:00
Evan Tschannen 2d74288d16 Added a comment to clarify why cleanup work is done in status 2019-10-22 16:33:44 -07:00
Evan Tschannen 3478652d06
Apply suggestions from code review
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2019-10-22 13:32:09 -07:00
Evan Tschannen d5c2147c0c
Update fdbserver/Status.actor.cpp
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2019-10-22 13:27:52 -07:00
Evan Tschannen 2caad04d9c Keys in the destUIDLookupPrefix can be cleaned up automatically if they do not have an associated entry in the logRangesRange keyspace 2019-10-22 11:58:40 -07:00
Evan Tschannen 12c517ab16 limit the number of committed version updates in progress simultaneously to prevent running out of memory 2019-10-21 16:01:45 -07:00
A.J. Beamon c25f6b8ae3
Merge pull request #2267 from mpilman/bugfixes/fix-version
fixed cmake version
2019-10-21 11:42:01 -07:00
mpilman 2d0722b0c7 fixed cmake version 2019-10-21 11:22:05 -07:00
mpilman a79757a788 Fix compiler errors on Catalina
Fixes #2263
2019-10-21 11:15:37 -07:00