Commit Graph

12309 Commits

Author SHA1 Message Date
Meng Xu 046260b9d7 FastRestore:Applier:Assert to ensure batchData will not be used after deleted 2020-08-17 22:42:41 -07:00
Meng Xu 4a0315483b FastRestore:Safeguard when request of earlier vb may be sent after the vb has finished 2020-08-17 22:20:54 -07:00
Meng Xu 7b7490efe7 FastRestore:Debug trace for seg fault 2020-08-17 20:34:33 -07:00
Jingyu Zhou 8f9ae86212
Merge pull request #3655 from dongxinEric/bugfix/fix-potential-invalid-memory-access-bug
Fix potential invalid memory access bug.
2020-08-17 15:56:24 -07:00
Xiaoxi Wang 24dbb3961c Knob adjustment 2020-08-17 22:38:22 +00:00
Xin Dong 130bd7ac22 Fixed a bug that would potentially cause invalid memory access, i.e. segmentation fault. 2020-08-17 13:16:17 -07:00
Jingyu Zhou 7752fd700c
Merge pull request #3651 from jzhou77/release-6.3
Backport restarting test fix to 6.3
2020-08-16 22:04:23 -07:00
Young Liu 421ed80295 Recover the machine count to be 12 2020-08-16 15:10:36 -07:00
Meng Xu 01255b7ead FastRestoreLoader:Sched:Add trace field and misc code style improvement 2020-08-16 09:43:04 -07:00
Jingyu Zhou 2295bb223a Bump to 5.0.0 as 4.6.4 is using version larger than hasMultiGenerationTLog() 2020-08-16 09:29:14 -07:00
Jingyu Zhou 1a59926d75 Limit Storefront and Cycle restart tests to 4.6.0 and up
The assertion in DBCoreState.h insists on hasMultiGenerationTLog(), which is
only available on 4.6.0 and up versions.
2020-08-16 09:29:06 -07:00
Meng Xu be75fd4894 Workaround flow limitation:state variable must be initialized at the beginning of actors 2020-08-16 08:45:13 -07:00
Meng Xu c2dfc5a00a Fix compile error 2020-08-16 08:13:28 -07:00
Meng Xu cb0e44ff42 FastRestoreLoader:Sched send mutations per loadingParam requests 2020-08-16 07:38:51 -07:00
Meng Xu 98167a6d20 FastRestoreLoader:Fix:sched may stuck due to race condition 2020-08-16 06:29:09 -07:00
Meng Xu 015397be74 FastRestore:LoaderScheduler:Control number of load request to release at once 2020-08-15 22:18:48 -07:00
Meng Xu 1e571a5a1a FastRestore:Loader:Kick off scheduler when loader starts to have new requests 2020-08-15 21:57:00 -07:00
Meng Xu a035e7a872 FastRestore:LoaderScheduler:Add knobs 2020-08-15 21:44:51 -07:00
Meng Xu 7e302b5910 FastRestore:Loader:Add scheduler to dispatch requests based on resource utilization and request priority 2020-08-15 21:21:51 -07:00
Steve Atherton 090241f0df Count BTreeCursor page reads that come from the cursor's cache of pages as cache hits in RedwoodMetrics. BTree Unit Test now verifies all data at the initial version after recovery from disk. 2020-08-15 14:30:49 -07:00
Steve Atherton 84a4d040c1 Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-redwood 2020-08-15 14:09:03 -07:00
Markus Pilman dee8df9b48
Merge pull request #3646 from sfc-gh-xwang/valgrind-option
turn off avx instruction when enable valgrind
2020-08-15 08:53:53 -06:00
Steve Atherton 421f44f4cc
Merge pull request #3640 from sfc-gh-tclinkenbeard/fix-asyncfileblobstore-lock
Fix potential memory leak in AsyncFileBlobStore
2020-08-14 18:09:34 -07:00
Xiaoxi Wang ffa1973242 move OPERATION_COST_BYTE_FACTOR to CLIENT_KNOB; skip the first call of refreshBusiestTag. 2020-08-14 22:49:20 +00:00
Russell Sears 89d1df4a5c
Merge pull request #3645 from Daniel-B-Smith/rocks-opt-checkpoint
Add some RocksDB optimizations and configuration knobs
2020-08-14 14:25:52 -07:00
XiaoxiWang 1c96a37a77 turn off avx instruction when enable valgrind 2020-08-14 21:14:48 +00:00
Xiaoxi Wang 548ba06510 change map to deque; code style problem 2020-08-14 18:30:58 +00:00
Daniel Smith 94571786bf Add RocksDB work 2020-08-14 17:16:20 +00:00
Xiaoxi Wang 475d4cca72 solve some cr comments 2020-08-14 16:40:16 +00:00
Xiaoxi Wang e94de126de merge with master 2020-08-14 01:59:09 +00:00
Xin Dong ce05bb2a26
Merge pull request #3617 from xumengpanda/tmp/trace-PR
Resolve throttling events
2020-08-13 16:31:55 -07:00
Young Liu 19df032aec Change some formatting issues 2020-08-13 15:30:21 -07:00
Young Liu 4a30492186 Remove debug trace 2020-08-13 14:42:00 -07:00
Young Liu 20700f75f4 Merge master 2020-08-13 14:28:27 -07:00
Evan Tschannen 6f98ed3d24 Merge branch 'release-6.3' into feature-proxy-busy-loadbalance 2020-08-13 11:30:28 -07:00
A.J. Beamon af0f3888b2
Merge pull request #3643 from Daniel-B-Smith/patch-1
Correct fix for debug ID logging
2020-08-13 11:18:50 -07:00
Daniel Smith b2bba8ccbb
Correct fix for debug ID logging 2020-08-13 13:37:15 -04:00
Steve Atherton 051ec7066a BTree unit test duration now targets a number of page read/writes so it should time out less often. 2020-08-13 01:50:51 -07:00
Meng Xu b1e9e9cd79
Merge pull request #3639 from xumengpanda/tmp/merge-PR
Merge release 6.3 to master and resolve conflicts
2020-08-12 22:52:35 -07:00
Jingyu Zhou 4309fd2d82
Merge pull request #3636 from sfc-gh-mpilman/bugfix/remove-generated-file
Remove file that is generated from cmake
2020-08-12 22:35:54 -07:00
Meng Xu ced4f8c49f fix: getReadHotRanges should be const function 2020-08-12 22:18:28 -07:00
sfc-gh-tclinkenbeard 633565aa1a Use std::make_shared for AsyncFileBlobStore lock 2020-08-12 20:30:03 -07:00
Meng Xu 002cca5e58 Merge branch 'master' into tmp/merge-PR
Conflicts:
	fdbclient/NativeAPI.actor.cpp
	fdbserver/StorageMetrics.actor.h
2020-08-12 20:08:13 -07:00
Evan Tschannen 539366156c more fixes 2020-08-12 17:26:20 -07:00
Evan Tschannen 7c84e04028 fixed compiler errors 2020-08-12 17:22:37 -07:00
Evan Tschannen c72068d6b5 clients load balance across proxies based on process busyness instead of number of requests 2020-08-12 17:17:21 -07:00
Young Liu 8953cc5f98 Merge master again 2020-08-12 16:59:07 -07:00
Xin Dong 8bc57c16f0
Merge pull request #3637 from dongxinEric/misc/fix-spammy-readhot-logging
Increased some knobs to throttle the spammy read hot logging.
2020-08-12 16:46:32 -07:00
Xiaoxi Wang 8f1deaa47e Merge branch 'master' of https://github.com/apple/foundationdb 2020-08-12 23:32:23 +00:00
Xin Dong e13e7c5725
Update fdbserver/workloads/ReadHotDetection.actor.cpp
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2020-08-12 15:48:01 -07:00