Commit Graph

11627 Commits

Author SHA1 Message Date
Xin Dong 130bd7ac22 Fixed a bug that would potentially cause invalid memory access, i.e. segmentation fault. 2020-08-17 13:16:17 -07:00
Jingyu Zhou 7752fd700c
Merge pull request #3651 from jzhou77/release-6.3
Backport restarting test fix to 6.3
2020-08-16 22:04:23 -07:00
Meng Xu 01255b7ead FastRestoreLoader:Sched:Add trace field and misc code style improvement 2020-08-16 09:43:04 -07:00
Jingyu Zhou 2295bb223a Bump to 5.0.0 as 4.6.4 is using version larger than hasMultiGenerationTLog() 2020-08-16 09:29:14 -07:00
Jingyu Zhou 1a59926d75 Limit Storefront and Cycle restart tests to 4.6.0 and up
The assertion in DBCoreState.h insists on hasMultiGenerationTLog(), which is
only available on 4.6.0 and up versions.
2020-08-16 09:29:06 -07:00
Meng Xu be75fd4894 Workaround flow limitation:state variable must be initialized at the beginning of actors 2020-08-16 08:45:13 -07:00
Meng Xu c2dfc5a00a Fix compile error 2020-08-16 08:13:28 -07:00
Meng Xu cb0e44ff42 FastRestoreLoader:Sched send mutations per loadingParam requests 2020-08-16 07:38:51 -07:00
Meng Xu 98167a6d20 FastRestoreLoader:Fix:sched may stuck due to race condition 2020-08-16 06:29:09 -07:00
Meng Xu 015397be74 FastRestore:LoaderScheduler:Control number of load request to release at once 2020-08-15 22:18:48 -07:00
Meng Xu 1e571a5a1a FastRestore:Loader:Kick off scheduler when loader starts to have new requests 2020-08-15 21:57:00 -07:00
Meng Xu a035e7a872 FastRestore:LoaderScheduler:Add knobs 2020-08-15 21:44:51 -07:00
Meng Xu 7e302b5910 FastRestore:Loader:Add scheduler to dispatch requests based on resource utilization and request priority 2020-08-15 21:21:51 -07:00
Steve Atherton 090241f0df Count BTreeCursor page reads that come from the cursor's cache of pages as cache hits in RedwoodMetrics. BTree Unit Test now verifies all data at the initial version after recovery from disk. 2020-08-15 14:30:49 -07:00
Steve Atherton 84a4d040c1 Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-redwood 2020-08-15 14:09:03 -07:00
Russell Sears 89d1df4a5c
Merge pull request #3645 from Daniel-B-Smith/rocks-opt-checkpoint
Add some RocksDB optimizations and configuration knobs
2020-08-14 14:25:52 -07:00
Daniel Smith 94571786bf Add RocksDB work 2020-08-14 17:16:20 +00:00
Xin Dong ce05bb2a26
Merge pull request #3617 from xumengpanda/tmp/trace-PR
Resolve throttling events
2020-08-13 16:31:55 -07:00
Evan Tschannen 6f98ed3d24 Merge branch 'release-6.3' into feature-proxy-busy-loadbalance 2020-08-13 11:30:28 -07:00
A.J. Beamon af0f3888b2
Merge pull request #3643 from Daniel-B-Smith/patch-1
Correct fix for debug ID logging
2020-08-13 11:18:50 -07:00
Daniel Smith b2bba8ccbb
Correct fix for debug ID logging 2020-08-13 13:37:15 -04:00
Steve Atherton 051ec7066a BTree unit test duration now targets a number of page read/writes so it should time out less often. 2020-08-13 01:50:51 -07:00
Evan Tschannen 539366156c more fixes 2020-08-12 17:26:20 -07:00
Evan Tschannen 7c84e04028 fixed compiler errors 2020-08-12 17:22:37 -07:00
Evan Tschannen c72068d6b5 clients load balance across proxies based on process busyness instead of number of requests 2020-08-12 17:17:21 -07:00
Xin Dong 8bc57c16f0
Merge pull request #3637 from dongxinEric/misc/fix-spammy-readhot-logging
Increased some knobs to throttle the spammy read hot logging.
2020-08-12 16:46:32 -07:00
Xin Dong e13e7c5725
Update fdbserver/workloads/ReadHotDetection.actor.cpp
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2020-08-12 15:48:01 -07:00
Xin Dong ddec93c504
Update fdbclient/StorageServerInterface.h
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2020-08-12 15:47:32 -07:00
Xin Dong b17667323e Resolve review comments 2020-08-12 15:15:25 -07:00
Meng Xu f26f170f21
Merge pull request #3635 from Daniel-B-Smith/debug-logging-fix
Make logging of server trace ID consistent with other code
2020-08-12 15:06:26 -07:00
Xin Dong 3ac6996844 Increased some knobs to throttle the spammy read hot logging. Also added more details inside the read hot log to make it useful 2020-08-12 14:27:34 -07:00
Steve Atherton 215a0ad42c Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-redwood 2020-08-12 12:06:56 -07:00
Daniel Smith cc1059be75 Make logging of server trace ID consistent with other code 2020-08-12 19:05:01 +00:00
Meng Xu 13ddf0618f
Merge pull request #3632 from xumengpanda/tmp/fix-6.3-fr-PR
Fast Restore: Fix an incorrect ASSERT
2020-08-12 12:02:53 -07:00
Meng Xu 0d0efcfce7 FR:Fix incorrect ASSERT:batchIndex starts at 1 instead of 0 2020-08-12 10:36:31 -07:00
Steve Atherton a817c9abbe Redwood metrics was adding details with empty names. 2020-08-12 03:24:23 -07:00
Steve Atherton 729fce9f0e Merge branch 'release-6.3' of github.com:apple/foundationdb into feature-redwood 2020-08-12 02:59:01 -07:00
Steve Atherton c1ccbc3d27 Bug fixes. Internal page update would be missed if child page ID updates were expected but none were done. When rebuilding internal pages, child page ID updates were being written to the original page memory instead of the rebuild record set. 2020-08-12 01:33:07 -07:00
Meng Xu 72cabfd253
Merge pull request #2596 from alexmiller-apple/docs/technical-overview
Convert "Architecture Overview" wiki page into documentation
2020-08-11 20:36:48 -07:00
A.J. Beamon 40cc7e2aad
Merge pull request #3619 from AlvinMooreSr/fix_javadoc
JavaDoc Fixes
2020-08-11 11:11:01 -07:00
Meng Xu 06dae74730 Revert change to ReadHotRangeLog event 2020-08-11 11:04:57 -07:00
Alvin Moore 1933826737 Fixed typos and removed extraneous space 2020-08-11 13:09:41 -04:00
Alvin Moore ba9f203858 Fixed warnings for documentation greater than and less than characters which appear as errors within Java 1.8
Removed broken link
2020-08-11 03:26:56 -04:00
Meng Xu 97e49f2f70 Resolve throttling events 2020-08-10 22:01:12 -07:00
Meng Xu c5c6906a3d
Merge pull request #3600 from xumengpanda/mengxu/fr-fix-large-pkg-PR
Fast Restore: Fix the sampling packet size at sampling phase
2020-08-10 13:53:24 -07:00
Meng Xu 7c05e9c1d3
Merge pull request #3610 from xis19/issue_3551
When a configuration K/V pair is modified, always output the K/V pair values
2020-08-10 13:52:44 -07:00
Russell Sears 4c4df7b2a0
Merge pull request #3547 from AlvinMooreSr/docker_tz
Build Docker Update
2020-08-10 11:59:14 -07:00
Xin Dong d198c310f4
Merge pull request #3614 from dongxinEric/misc/avoid-extra-copy-for-getEstiamtedRangeSizeAPI-6.3
Avoid the extra copy in RYW APIs
2020-08-10 11:02:38 -07:00
Xin Dong 5456b01c3a Avoid the extra copy in RYW APIs 2020-08-10 09:34:21 -07:00
Xiaoge Su 8e50b51fbd If mutableConfiguration exists, skip checking rawConfiguration in DatabaseConfiguration 2020-08-09 22:12:42 -07:00