Commit Graph

12309 Commits

Author SHA1 Message Date
Trevor Clinkenbeard 7cdd03dcab
Merge pull request #3682 from ajbeamon/fix-dd-blocking-issue
Don't block the data distributor when getting a GetDataDistributorMetricsRequest
2020-08-21 10:42:36 -07:00
A.J. Beamon 6380b92b10 Don't block the data distributor when getting a GetDataDistributorMetricsRequest. 2020-08-21 09:26:18 -07:00
Stewart Henderson 6a8da71e80 Issue 1647 Resolution 2020-08-21 06:12:39 -05:00
XiaoxiWang 1f134d1534 format 2020-08-21 05:06:13 +00:00
XiaoxiWang 9398a78a3a add busy-read count and busy-write count to status json 2020-08-21 04:50:56 +00:00
XiaoxiWang 476faa6521 change reason type 2020-08-21 04:07:25 +00:00
Xiaoxi Wang 88cb352e2e rename variables 2020-08-21 00:03:06 +00:00
Xiaoxi Wang 5aaf86206a add counter for expensive clear estimation for audit and trace 2020-08-20 23:00:45 +00:00
Xiaoxi Wang e375761581 Merge branch 'master' of https://github.com/apple/foundationdb 2020-08-20 20:29:14 +00:00
A.J. Beamon 9dd4589d61 Fix merge issue that resulted in commit and GV latency band info not being published. 2020-08-20 11:49:30 -07:00
Trevor Clinkenbeard 6077073ac9
Merge pull request #3673 from ajbeamon/fix-memory-error
Fix memory error caused by referencing a value with limited lifetime
2020-08-20 11:47:07 -07:00
Andrew Noyes 3737b8dd7b Add LockDatabaseFrequently to TxnStateStoreCycleTest 2020-08-20 18:45:42 +00:00
Andrew Noyes e42f1f23ae Add release note 2020-08-20 18:40:03 +00:00
A.J. Beamon f0cdfb8781 Fix memory error caused by referencing a value with limited lifetime. 2020-08-20 11:12:59 -07:00
Andrew Noyes 4dc2975f5a Only switch primary if extraDB != nullptr 2020-08-20 18:06:24 +00:00
Andrew Noyes 30c086ed96 Improve comment
Also use push_back. The lifetime of databaseLockedKey and
databaseLockedKeyEnd will outlive trRequest.arena, since they're
literals.
2020-08-20 18:05:03 +00:00
XiaoxiWang 7dcce6979e format 2020-08-20 07:00:37 +00:00
XiaoxiWang 0945959a35 add fdbcli support to list recommended tags 2020-08-20 06:26:31 +00:00
sfc-gh-tclinkenbeard 6e0df3b9ac Fix AsyncFileWinASIO build 2020-08-19 21:05:56 -07:00
Andrew Noyes 9cf3041393 Add read conflict for metadata txs that aren't lock-aware 2020-08-20 02:52:37 +00:00
Andrew Noyes bc5da1f6d7 Add LockDatabaseFrequently to VersionStamp test 2020-08-20 02:33:06 +00:00
sfc-gh-tclinkenbeard c8b774a30a Explicitly mark IAsyncFile functions as overrided 2020-08-19 18:17:32 -07:00
sfc-gh-tclinkenbeard 157700e5b6 Make IAsyncFile const-correct 2020-08-19 17:34:56 -07:00
Andrew Noyes fbc97a12b8 Add LockDatabaseFrequently workload 2020-08-19 23:17:38 +00:00
Xiaoxi Wang 9c709b33d6 scale cost 2020-08-19 19:47:41 +00:00
XiaoxiWang bc6e42c634 add status json report for recommended throttled tags 2020-08-19 19:22:16 +00:00
Meng Xu 422784d545 FastRestore:Send reply before assert fail 2020-08-19 11:25:08 -07:00
A.J. Beamon 0e03fbe7b3
Merge pull request #3659 from AlvinMooreSr/dev_docker_update
Updated Development Docker
2020-08-19 10:41:58 -07:00
Meng Xu d9ea14ea6c FastRestore:fix:loader can receive reply from vb that has been processed and deleted 2020-08-19 10:39:49 -07:00
XiaoxiWang aa253742ec add getRecommendedTags to ThrottleApi 2020-08-19 17:39:43 +00:00
Jingyu Zhou 4867bad46e
Merge pull request #3661 from sfc-gh-kmakino/kaomakino/remove_unnecessary_test_harness_tweaks
Remove unnecessary special case handling from JsonParser
2020-08-19 09:54:20 -07:00
XiaoxiWang 8a1b9394b8 do not send auto-throttled tags to proxy is autoThrottleEnabled == false 2020-08-19 16:23:11 +00:00
Meng Xu 22a2fac689 FastRestore:Fix segmentation fault when previous duplicate request is sent too late
This seg fault was not caught by simulation test;
It is only reproduced very easily in circus test.

Add an ASSERT to check if the scenario happens in simulation
2020-08-19 09:15:18 -07:00
Meng Xu 7bfb0a4cc5
Merge pull request #3662 from sfc-gh-tclinkenbeard/modernize-copy-disable
Use =delete to disable special member functions
2020-08-19 00:13:12 -07:00
Meng Xu 88b94a3e59 FastRestore:Fix:Delayed request can be skipped from processing
When a request of sending mutations to appliers is delayed and the request for future version batches have been processed,
loader will increase its counter. The previous implementation will use the counter to decide if a request is too old and
have been processed. If the counter is larger than the batch index of the request, the request will be ignored although
it may not have been processed.

This causes correctness test failure for fast restore.
2020-08-18 23:48:06 -07:00
Xiaoxi Wang 599675cba8 modify some details to get better performance 2020-08-19 04:23:23 +00:00
Steve Atherton 9c0c2db4b2
Merge pull request #3658 from sfc-gh-tclinkenbeard/construct-flowlock-releaser
Construct FlowLock::Releaser before AsyncFileBlobStore upload
2020-08-18 18:00:42 -07:00
Steve Atherton d53e6cf687 Bug fix in KV byte counts. 2020-08-18 17:58:57 -07:00
Meng Xu 33f5ce98c7 Merge branch 'release-6.3' into mengxu/fr-sched-PR 2020-08-18 17:41:31 -07:00
Meng Xu e1d150662f FastRestore:small fix on compile error 2020-08-18 16:15:11 -07:00
Meng Xu 6729b4143b FastRestore:Requests:Add const for toString function 2020-08-18 16:05:23 -07:00
Meng Xu a32cf7d293 FastRestore:Loader:Add sanity check before remove batch data 2020-08-18 15:44:22 -07:00
Meng Xu 9b2f667bbe FastRestore:Fix uninitialized variable 2020-08-18 11:58:57 -07:00
sfc-gh-tclinkenbeard 7b210aee24 Use =delete to disable special member functions
This has the benefits of:
- Easier to understand compiler error messages
- Moves some errors from link-time to compile-time
- NonCopyable classes can still specify default move constructors
2020-08-18 11:07:00 -07:00
Kao Makino 2f76dd0b76 Remove unnecessary special case handling from JsonParser 2020-08-18 10:46:06 -07:00
Xiaoxi Wang 69914d4909 defer write throttling until found proper statistics for write saturation 2020-08-18 15:46:02 +00:00
Evan Tschannen 8ede143941 Track tlog push latencies and reset connections if they are above 500ms 2020-08-18 08:43:14 -07:00
Alvin Moore aa8bac49b2 Added cgdb package 2020-08-18 08:43:45 -04:00
sfc-gh-tclinkenbeard b8c06b3d15 Ensure FlowLock::Releaser is always constructed before AsyncFileBlobStore upload 2020-08-17 23:19:51 -07:00
Evan Tschannen 9e2ee1ed4c fixed lastedZeroBusy; added a knob 2020-08-17 23:16:59 -07:00