wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,526 Commits 31 Branches 299 Tags 262 MiB
Commit Graph

7526 Commits

Author SHA1 Message Date
Evan Tschannen d3c4bd9c5a
Merge pull request #2289 from mpilman/eio_odirect_mt 
Use O_DIRECT with EIO and option to control concurrency
 2019-10-24 15:19:48 -07:00
Meng Xu 2383c29123 FastRestore:Use reference for handleInitVersionBatchRequest func 2019-10-24 13:54:44 -07:00
Jon Fu 2f34ee684f fixed indentation issues 2019-10-24 13:21:28 -07:00
Jon Fu b74e5b1543 added sample file for attrition test outside of simulation 2019-10-24 13:10:59 -07:00
Meng Xu 7903b47b82 FastRestore:Remove unnecessary return 2019-10-24 13:09:24 -07:00
Meng Xu c53f817c5e FastRestore:Convert handleInitVersionBatchRequest to plain func 2019-10-24 13:06:50 -07:00
Xin Dong f70000184e Log the number of samples captured for the read bandwidth to verify the assumption. 2019-10-24 13:05:23 -07:00
Meng Xu 60d26ff5d7 FastRestore:Resolve review comments 2019-10-24 12:52:12 -07:00
mpilman 92ce9ef5dc updated comment 2019-10-24 11:45:32 -07:00
mpilman 325a8e4213 remove confusing USE_ODIRECT knob 2019-10-24 11:44:03 -07:00
mpilman f23392ec5a Don't use O_DIRECT in EIO by default 2019-10-24 11:39:55 -07:00
mpilman 7ad0e20e48 Added knob to disable O_DIRECT 2019-10-24 11:20:14 -07:00
mpilman f41f19b5f6 Introduced knob to set eio parallelism 2019-10-24 11:20:14 -07:00
mpilman 85977fb8d5 Use O_DIRECT with EIO 2019-10-24 11:20:14 -07:00
Kao Makino 48aa55699a Cleanup mako c-binding benchmark 2019-10-24 18:14:55 +00:00
Xin Dong a290e2cb2b Use 8 MiB for real 2019-10-24 11:02:17 -07:00
Evan Tschannen f640aec1b6
Merge pull request #2288 from etschannen/release-6.2 
updated release notes
 2019-10-24 10:10:26 -07:00
Evan Tschannen 7579bc7e7e updated release notes 2019-10-24 10:09:37 -07:00
Evan Tschannen a2bc4173a4
Merge pull request #2286 from etschannen/feature-immediate-undesired 
Two bug fixes
 2019-10-24 10:02:44 -07:00
Jon Fu 5d7c84b803 moved shuffle outside of the conditional blocks 2019-10-24 09:45:04 -07:00
Evan Tschannen a7492aab0a fix: poppedVersion can update during a yield, so all work must be done immediately after getMore returns 2019-10-23 23:06:02 -07:00
Evan Tschannen f8e44d2f71 fix: If a storage server was offline, it would not be checked for being in an undesired dc 2019-10-23 23:04:39 -07:00
Meng Xu b1881a7c1c FastRestore:Apply clang-format 2019-10-23 20:49:14 -07:00
Meng Xu 1ae02dd1df FastRestore:AtomicOp test:Add sanity check for setup step 2019-10-23 17:28:21 -07:00
Meng Xu bae0c907a6 FastRestore:Convert unnecessary actor function to plain function 2019-10-23 15:10:34 -07:00
Jon Fu ab262e5e4d use StringRef over std::string for workload params 2019-10-23 14:55:28 -07:00
Meng Xu 7af3239ee7 FastRestore:AtomicOpTest:Debug:1 key per group for ops keyspace 2019-10-23 14:36:34 -07:00
Jon Fu 103cc37a35 added datahall kill and option to target a specific datahall/dc/machine id 2019-10-23 14:19:17 -07:00
Meng Xu ba7e499efe FastRestore:AtomicOpTest:Limit 1 actor per client 2019-10-23 14:04:14 -07:00
Evan Tschannen afb3cb7455
Merge pull request #2284 from etschannen/release-6.2 
Fixed a window build error
 2019-10-23 13:49:18 -07:00
Evan Tschannen eb910b850b fixed a window build error 2019-10-23 13:48:24 -07:00
Meng Xu 41f0cd624b FastRestore:Applier:Use shouldCommit to replace the duplicate code 2019-10-23 13:36:19 -07:00
Xin Dong fe54a4bde1 - Changed SHARD_MAX_BYTES_READ_PRE_KEYSEC to be equivalent to 8MiB/s, which when times the sample expire interval(120 seconds) yields 960MiB/s. A shard having a read rate larger than that will be marked as read-hot. The number 960MiB was chosen to be roughtly twice the size of the max allowed shard size to avoid wrongly marking a shard as read-hot when doing a table scan on it. 
- Also tuned down the empty key sampling percentage to be 5%.
 2019-10-23 12:00:19 -07:00
Evan Tschannen f90cb61e20
Merge pull request #2283 from etschannen/prepare-release-6.2.7 
update installer WIX GUID following release
 2019-10-23 11:55:45 -07:00
Evan Tschannen fc31c8dafa update installer WIX GUID following release 2019-10-23 11:55:04 -07:00
Evan Tschannen ec2070a8f7
Merge pull request #2282 from etschannen/release-6.2 
Prepare for release 6.2.7
 2019-10-23 11:52:19 -07:00
Jon Fu d97ff75638 added mode to specifically kill all workers with same machineId 2019-10-23 11:30:16 -07:00
Jon Fu 47dc0ee25c removed coordinator check and added pre-processing of workers rather than checking each cycle 2019-10-23 11:19:27 -07:00
Evan Tschannen 2f6b661b51 updated documentation for 6.2.7 2019-10-23 11:17:53 -07:00
Evan Tschannen 2722c8b188 avoid starting a new startSpillingActor with every TLog recruitment 2019-10-23 11:15:54 -07:00
Evan Tschannen ae3f8132a7
Merge pull request #2280 from satherton/feature-redwood 
Update redwood
 2019-10-23 10:57:38 -07:00
Evan Tschannen 9197b03122
Merge pull request #2279 from ajbeamon/latency-band-ignore-batch 
Ignore batch priority GRVs for latency band tracking
 2019-10-23 10:52:44 -07:00
Evan Tschannen e01e8371a6
Merge pull request #2256 from alexmiller-apple/spill-log-on-switch-6.2 
Spill SharedTLog when there's more than one
 2019-10-23 10:51:28 -07:00
Evan Tschannen c1731e3b8d
Merge pull request #2276 from alexmiller-apple/fix-10min-stall-again-6.2 
More fixes to prevent 10min stalls in recovering secondaries
 2019-10-23 10:45:55 -07:00
A.J. Beamon 84bd55caa3 Add release note 2019-10-23 10:41:09 -07:00
A.J. Beamon a1bed51d34 Ignore batch priority GRVs for latency band tracking 2019-10-23 10:29:58 -07:00
Stephen Atherton 0e51a248b4 Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-redwood 2019-10-23 10:12:54 -07:00
Jon Fu 6583c499f8 Merge branch 'master' of https://github.com/apple/foundationdb into modify-attrition 2019-10-23 09:42:14 -07:00
Stephen Atherton 613bbaecc4 Bug fix in queue page footprint tracking. Added VersionedBTree::destroyAndCheckSanity() which clears the tree, processes the entire lazy delete queue, and then verifies some pager usage statistics. This check is currently disabled because it appears to find a bug where the final state has a few more pages in use than expected. StorageBytes now includes the delayed free list pages as free space since they will be reusable soon. 2019-10-23 09:31:06 -07:00
Alex Miller 0c325c5351 Always check which SharedTLog is active 
In case it is set before we get to the onChange()
 2019-10-23 01:59:36 -07:00