Stephen Atherton
2ee1782c19
Bug fixes in Redwood. BTree height was not being reset when a new empty root is written. IKeyValueStore wrapper was not obeying the row limit in a reverse range query. Added yields to and delays to break up tasks and set IO priorities.
2019-10-25 14:52:06 -07:00
Evan Tschannen
1d26ca4aa7
Merge pull request #2293 from etschannen/release-6.2
...
fixed Javadoc headings
2019-10-25 13:40:16 -07:00
Evan Tschannen
0953bf376d
fixed Javadoc headings
2019-10-25 13:38:04 -07:00
Evan Tschannen
fc9497be33
Merge pull request #2291 from etschannen/post-release-cleanup-6.2.7
...
Post release cleanup 6.2.7
2019-10-24 17:06:06 -07:00
Evan Tschannen
fdb0bcdfbc
update cmake to 6.2.8
2019-10-24 17:05:45 -07:00
Evan Tschannen
9682528372
update installer WIX GUID following release
2019-10-24 17:02:56 -07:00
Evan Tschannen
acbfc70373
update versions target to 6.2.8
2019-10-24 17:02:56 -07:00
Evan Tschannen
d3c4bd9c5a
Merge pull request #2289 from mpilman/eio_odirect_mt
...
Use O_DIRECT with EIO and option to control concurrency
2019-10-24 15:19:48 -07:00
mpilman
92ce9ef5dc
updated comment
2019-10-24 11:45:32 -07:00
mpilman
325a8e4213
remove confusing USE_ODIRECT knob
2019-10-24 11:44:03 -07:00
mpilman
f23392ec5a
Don't use O_DIRECT in EIO by default
2019-10-24 11:39:55 -07:00
mpilman
7ad0e20e48
Added knob to disable O_DIRECT
2019-10-24 11:20:14 -07:00
mpilman
f41f19b5f6
Introduced knob to set eio parallelism
2019-10-24 11:20:14 -07:00
mpilman
85977fb8d5
Use O_DIRECT with EIO
2019-10-24 11:20:14 -07:00
Evan Tschannen
f640aec1b6
Merge pull request #2288 from etschannen/release-6.2
...
updated release notes
2019-10-24 10:10:26 -07:00
Evan Tschannen
7579bc7e7e
updated release notes
2019-10-24 10:09:37 -07:00
Evan Tschannen
a2bc4173a4
Merge pull request #2286 from etschannen/feature-immediate-undesired
...
Two bug fixes
2019-10-24 10:02:44 -07:00
Evan Tschannen
a7492aab0a
fix: poppedVersion can update during a yield, so all work must be done immediately after getMore returns
2019-10-23 23:06:02 -07:00
Evan Tschannen
f8e44d2f71
fix: If a storage server was offline, it would not be checked for being in an undesired dc
2019-10-23 23:04:39 -07:00
Evan Tschannen
afb3cb7455
Merge pull request #2284 from etschannen/release-6.2
...
Fixed a window build error
2019-10-23 13:49:18 -07:00
Evan Tschannen
eb910b850b
fixed a window build error
2019-10-23 13:48:24 -07:00
Evan Tschannen
f90cb61e20
Merge pull request #2283 from etschannen/prepare-release-6.2.7
...
update installer WIX GUID following release
2019-10-23 11:55:45 -07:00
Evan Tschannen
fc31c8dafa
update installer WIX GUID following release
2019-10-23 11:55:04 -07:00
Evan Tschannen
ec2070a8f7
Merge pull request #2282 from etschannen/release-6.2
...
Prepare for release 6.2.7
2019-10-23 11:52:19 -07:00
Evan Tschannen
2f6b661b51
updated documentation for 6.2.7
2019-10-23 11:17:53 -07:00
Evan Tschannen
2722c8b188
avoid starting a new startSpillingActor with every TLog recruitment
2019-10-23 11:15:54 -07:00
Evan Tschannen
ae3f8132a7
Merge pull request #2280 from satherton/feature-redwood
...
Update redwood
2019-10-23 10:57:38 -07:00
Evan Tschannen
9197b03122
Merge pull request #2279 from ajbeamon/latency-band-ignore-batch
...
Ignore batch priority GRVs for latency band tracking
2019-10-23 10:52:44 -07:00
Evan Tschannen
e01e8371a6
Merge pull request #2256 from alexmiller-apple/spill-log-on-switch-6.2
...
Spill SharedTLog when there's more than one
2019-10-23 10:51:28 -07:00
Evan Tschannen
c1731e3b8d
Merge pull request #2276 from alexmiller-apple/fix-10min-stall-again-6.2
...
More fixes to prevent 10min stalls in recovering secondaries
2019-10-23 10:45:55 -07:00
A.J. Beamon
84bd55caa3
Add release note
2019-10-23 10:41:09 -07:00
A.J. Beamon
a1bed51d34
Ignore batch priority GRVs for latency band tracking
2019-10-23 10:29:58 -07:00
Stephen Atherton
0e51a248b4
Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-redwood
2019-10-23 10:12:54 -07:00
Stephen Atherton
613bbaecc4
Bug fix in queue page footprint tracking. Added VersionedBTree::destroyAndCheckSanity() which clears the tree, processes the entire lazy delete queue, and then verifies some pager usage statistics. This check is currently disabled because it appears to find a bug where the final state has a few more pages in use than expected. StorageBytes now includes the delayed free list pages as free space since they will be reusable soon.
2019-10-23 09:31:06 -07:00
Alex Miller
0c325c5351
Always check which SharedTLog is active
...
In case it is set before we get to the onChange()
2019-10-23 01:59:36 -07:00
Alex Miller
1e5b8c74e3
Continuing a parallel peek after a timeout would hang.
...
This is to guard against the case where
1. Peeks with sequence numbers 0-39 are submitted
2. A 15min pause happens, in which timeout removes the peek tracker data
3. Peeks with sequence numbers 40-59 are submitted, with the same peekId
The second round of peeks wouldn't have the data left that it's allowed
to start running peek 40 immediately, and thus would hang for 10min
until it gets cleaned up.
Also, guard against overflowing the sequence number.
2019-10-22 19:24:05 -07:00
Evan Tschannen
f65f0cd37a
Merge pull request #2274 from etschannen/feature-cleanup-destuidlookup
...
Automatically cleanup backup and DR sharing metadata
2019-10-22 19:11:23 -07:00
Alex Miller
c008e7f8b3
When switching parallel->single->parallel, reset sequence and peekId
...
This fixes an issue where one could hang for 10min for the second
parallel peek to time out, if one happened to catch the edge of a
onlySpilled transition wrong.
2019-10-22 19:10:58 -07:00
Evan Tschannen
3bebcca846
Merge pull request #2266 from mpilman/bugfixes/catalina
...
Fix compiler errors on Catalina
2019-10-22 19:09:49 -07:00
Evan Tschannen
15f82a2295
Merge pull request #2270 from etschannen/feature-limit-updates
...
Limit the number of simultaneous committed version updates
2019-10-22 19:09:28 -07:00
Stephen Atherton
6a57fab431
Bug fixes in lazy subtree deletion, queue pushFront(), queue flush(), and advancing the oldest pager version. CommitSubtree no longer forces page rewrites due to boundary changes. IPager2 and IVersionedStore now have explicit async init() functions to avoid returning futures from some frequently used functions.
2019-10-22 17:17:29 -07:00
Evan Tschannen
35ac0071a8
fixed a compiler error
2019-10-22 17:06:54 -07:00
Evan Tschannen
2d74288d16
Added a comment to clarify why cleanup work is done in status
2019-10-22 16:33:44 -07:00
Evan Tschannen
3478652d06
Apply suggestions from code review
...
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2019-10-22 13:32:09 -07:00
Evan Tschannen
d5c2147c0c
Update fdbserver/Status.actor.cpp
...
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
2019-10-22 13:27:52 -07:00
Evan Tschannen
2caad04d9c
Keys in the destUIDLookupPrefix can be cleaned up automatically if they do not have an associated entry in the logRangesRange keyspace
2019-10-22 11:58:40 -07:00
Evan Tschannen
12c517ab16
limit the number of committed version updates in progress simultaneously to prevent running out of memory
2019-10-21 16:01:45 -07:00
A.J. Beamon
c25f6b8ae3
Merge pull request #2267 from mpilman/bugfixes/fix-version
...
fixed cmake version
2019-10-21 11:42:01 -07:00
mpilman
2d0722b0c7
fixed cmake version
2019-10-21 11:22:05 -07:00
mpilman
a79757a788
Fix compiler errors on Catalina
...
Fixes #2263
2019-10-21 11:15:37 -07:00