Commit Graph

11647 Commits

Author SHA1 Message Date
Meng Xu aa683c0d26 FRApplier:Fix applyingDataBytes accounting at exception
When exception is thrown out after txnSize is calculated but before
it is accounted into applyingDataBytes, we will decrease applyingDataBytes in the
error handling block incorrectly.
2020-09-23 15:19:02 -07:00
Alvin Moore 40b51cbdbb Added support to specify the FDB Cluster Text
Added support fo specify the number of ports from which to choose
Swapped tabs for spaces to make Marcus happy 😃
2020-09-23 17:58:47 -04:00
Kao Makino 5d60663bbf Make bindingtester scripts more k8s friendly 2020-09-23 16:14:19 -04:00
Meng Xu a4aad591fd FR:Remove applyStagingKeysBatchLock flow lock 2020-09-23 08:47:37 -07:00
Evan Tschannen f9a2ca1c33
Merge pull request #3799 from etschannen/feature-apiverison-batch-error
Protect api versions older than 630 from seeing batch_transaction_throttled
2020-09-22 23:18:23 -07:00
Evan Tschannen e82076a75c updated documentation for 6.3.6 2020-09-22 22:36:36 -07:00
Evan Tschannen b37daf88d4 add jitter to the delay 2020-09-22 22:24:40 -07:00
Evan Tschannen 09ff05c629 backed out buggify of apiVersion because there are too many tests that depend on it for a patch release 2020-09-22 21:15:49 -07:00
Evan Tschannen 850ec6aa43 fixed compile error 2020-09-22 20:27:10 -07:00
Evan Tschannen 814df222b9 testRywLifetime fails below API version 630 2020-09-22 20:18:15 -07:00
Meng Xu 6da7e56e03 FastRestore:Add more trace events 2020-09-22 19:57:19 -07:00
Evan Tschannen e0fbadfeb5 Added a buggify so older API versions are run in simulation 2020-09-22 18:58:01 -07:00
Evan Tschannen c99627a7ab Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-apiverison-batch-error 2020-09-22 17:06:17 -07:00
Evan Tschannen 7dec47938e protect api versions older than 630 from seeing batch_transaction_throttled errors 2020-09-22 17:05:09 -07:00
Meng Xu 08e243a07e Fix assert failure at addCallbackAndDelFutureRef 2020-09-22 15:41:07 -07:00
Meng Xu c16d76745d FastRestore:small fix compilation error 2020-09-22 13:36:26 -07:00
Meng Xu f8c5d85b79 FastRestore:Catch controller error and fix unhandled error occurred in updateHeartbeatTime 2020-09-22 13:32:26 -07:00
Meng Xu 17ece3d477 FastRestore:Fix FastRestoreApplierTransactionRateControl events 2020-09-22 13:25:43 -07:00
Meng Xu b4254473d7 FastRestore:Add transaction rate info tracer 2020-09-22 09:10:11 -07:00
Meng Xu 002b1bec4c FastRestore:Control write traffic at each applier
Controller assigns each applier a write rate.
Applier keeps the write-rate worth of transactions outstanding to DB.

This is to avoid heavily overloading DB while still keep enough
traffic to DB to get a good write throughput.
2020-09-22 08:14:28 -07:00
Meng Xu 6cfc1e876f
Merge pull request #3703 from yliucode/range
Extend backup container to support query restorable files by key ranges
2020-09-18 14:18:14 -07:00
A.J. Beamon 5d9b80e061
Merge pull request #3786 from sfc-gh-anoyes/anoyes/fix-trace-blocking
Fix trace blocking outside of simulation
2020-09-18 08:13:20 -07:00
Young Liu 7ac443df51 Add release notes 2020-09-17 18:17:33 -07:00
Young Liu 6032a21d30 Fix comment 2020-09-17 18:02:23 -07:00
Young Liu 60ccaa2ae9 Support finding max restorable version for key ranges when keyspace's max restorable version is unavailable 2020-09-17 17:58:58 -07:00
Young Liu d4e3e98957 Use new getRestoreSet in RestoreController 2020-09-17 17:56:36 -07:00
Young Liu 71309a79f9 Merge branch 'release-6.3' into range 2020-09-17 17:54:33 -07:00
Xin Dong ba2dc2dc73
Merge pull request #3783 from ajbeamon/update-go-subspace-range-docs
Give more detail when describing the range API on a subspace in Go
2020-09-17 14:52:50 -07:00
Andrew Noyes d6e6e96e1f Weaken claims in documentation
In some cases with the multiversion client the deadlock won't be
detected
2020-09-17 20:51:08 +00:00
Andrew Noyes bcf314bd29 Add release note 2020-09-17 20:35:35 +00:00
Andrew Noyes 01998a238f Add blockUntilReadyCheckOnMainThread 2020-09-17 20:26:28 +00:00
A.J. Beamon 507e6d0395 Merge branch 'release-6.3' into update-go-subspace-range-docs 2020-09-17 11:32:21 -07:00
Meng Xu f9e229ac1e
Merge pull request #3784 from ajbeamon/fix-switch-statement-fallthrough
Fix fall through in switch statement
2020-09-17 10:03:17 -07:00
A.J. Beamon 0c98a145b9
Fix whitespace 2020-09-17 08:09:21 -07:00
A.J. Beamon 303e1dc0c6 Fix fall through in switch statement 2020-09-17 08:07:53 -07:00
A.J. Beamon 1882410334 Give more detail when describing the range API on a subspace in Go. 2020-09-16 16:25:12 -07:00
A.J. Beamon 96a39d6749
Merge pull request #3778 from sfc-gh-anoyes/anoyes/disallow-block-on-main-thread
Disallow calling blockUntilReady from main thread
2020-09-16 15:56:29 -07:00
Andrew Noyes fb49257295 Revert trace change now that blocking on a ready future is ok 2020-09-16 21:53:14 +00:00
Andrew Noyes 8645801763 Update documentation 2020-09-16 21:52:10 +00:00
Andrew Noyes f6412c9f82 Only throw if the future is not ready 2020-09-16 21:34:13 +00:00
Evan Tschannen 1fe31aa9e8
Merge pull request #3706 from yliucode/tlogs
Report missing old tlogs in recovery before storage servers are fully recovered
2020-09-16 14:07:06 -07:00
Young Liu c34bdfdfab
Merge pull request #2 from xumengpanda/yang/range-metadata-file
Review comments and integrate extended getRestoreSet API into fast restore
2020-09-15 22:31:41 -07:00
Xiaoge Su 73b7c20344
Merge pull request #3780 from xumengpanda/mengxu/atomicOpTest-PR
Add MinV2 and AddV2 test into AtomicOp workload
2020-09-15 12:47:38 -07:00
Meng Xu ed2d261266 Add MinV2 and AndV2 into AtomicOps test workload 2020-09-15 10:01:36 -07:00
Andrew Noyes 734bdb72e1 Fix simulation trace impl occurence 2020-09-15 16:49:31 +00:00
Andrew Noyes 0beab42b78 Add blocked_from_network_thread error 2020-09-15 16:49:12 +00:00
Meng Xu 8224e17a08 Integrate extended getRestoreSet API into fast restore
The extended getRestoreSet provides a much smaller set of backup files for small keyrange restore;
This commit integrate it into fast restore so that fast restore does not have to filter out unneeded backup files.
2020-09-15 09:38:43 -07:00
Meng Xu f9a5b727a6 Add comments questions and TODOs 2020-09-14 16:28:01 -07:00
A.J. Beamon 792c639d99
Merge pull request #3721 from AlvinMooreSr/bindingtester
BindingTester Updates
2020-09-14 10:45:17 -07:00
Andrew Noyes 3c3943f64f Disallow calling blockUntilReady from main thread
Also fix a data race that apparently hasn't been ported to 6.2 yet
2020-09-14 16:01:45 +00:00