Commit Graph

4440 Commits

Author SHA1 Message Date
A.J. Beamon e0526e0095 Add busiest read tags to storage server status 2020-05-12 15:49:40 -07:00
A.J. Beamon 4f3f70e0c5 Fix: BusiestReadTag was logged before the first interval 2020-05-12 14:12:02 -07:00
A.J. Beamon acf1244317 Fix: ratekeeper was logging the auto throttle count for the manual throttle count 2020-05-12 14:10:40 -07:00
A.J. Beamon 30be00fd6c
Merge pull request #3145 from ajbeamon/fix-invalid-mem-access
Fix invalid memory access in ReadHotDetection test
2020-05-12 12:56:43 -07:00
A.J. Beamon bdc58eaa11 Fix invalid memory access in ReadHotDetection test due to memory being stored in a non-standalone stringref. 2020-05-12 11:16:35 -07:00
Xin Dong 696d95ebca Fix the possible dead loop when endKey got reset to equal to the beginKey. 2020-05-12 08:12:15 -07:00
Evan Tschannen a8e0f1d581 removed knob 2020-05-11 18:20:46 -07:00
Evan Tschannen c90ff6a6c3 revert loadBalanceDelay because it hurts read performance 2020-05-11 18:17:57 -07:00
Evan Tschannen 48b1b20f67 Fixed a crash related to destruction order in data distribution 2020-05-10 23:14:19 -07:00
Evan Tschannen f17f00fdd5 Merge branch 'release-6.2'
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
2020-05-10 22:33:38 -07:00
Meng Xu 67ead730cc
Merge pull request #3122 from sfc-gh-anoyes/anoyes/fix-get-exception-contract
Allow error_code_special_keys_no_module_found
2020-05-10 18:15:11 -07:00
Evan Tschannen d0b414ddf2
Merge pull request #3121 from etschannen/master
Added a large random delay on failure detection
2020-05-10 17:59:51 -07:00
Evan Tschannen 9d1df2aa58 fix: the first CPU estimate could be wrong enough to cause stalls on a newly recruited proxy 2020-05-10 17:50:09 -07:00
Evan Tschannen 3eaa9d6397 fix: do not report datacenter version difference before both datacenters report a correct version 2020-05-10 17:49:09 -07:00
Evan Tschannen b1bd5ef83e
Merge pull request #3120 from satherton/feature-redwood
Redwood read concurrency limit, some knobs, and memory-only Pager mode.
2020-05-10 17:34:41 -07:00
Andrew Noyes 4dc458d93c Allow error_code_special_keys_no_module_found
When getting a special key and the relaxed option isn't set
2020-05-11 00:18:40 +00:00
Evan Tschannen 07111f0e41 add a large random delay on failure detection so that not all storage servers need to attempt to become the cluster controller 2020-05-10 17:09:33 -07:00
Steve Atherton 43f9e4dfad Implemented concurrent read limit in IKeyValueStore interface for Redwood. Added knobs for Redwood page size, concurrent read limit, and page fill factor. Changed commitSubtree() recursion back to use a vector and waitForAll() because it seems to be lower overhead than ActorCollection. 2020-05-10 16:13:22 -07:00
Evan Tschannen 2ecea80539 removed unneeded debugging 2020-05-10 14:26:40 -07:00
Evan Tschannen 048201717c Fixed a number of problems with monitorLeaderRemotely 2020-05-10 14:20:50 -07:00
Steve Atherton ffbed1d84c Use actor collection for subtree recursions. 2020-05-10 11:44:07 -07:00
Steve Atherton f306666e21 Added commonPrefixLength for StringRefs that takes a prefix skip length. 2020-05-10 04:24:11 -07:00
Steve Atherton 5bb5bd2fd5 Improvements to Redwood set benchmark to improve readability and limit commit sizes to a record count or byte limit. 2020-05-10 04:21:25 -07:00
Steve Atherton 2ed43ebdf7 Added a non-persistent, memory-only option to DWALPager. 2020-05-10 02:19:19 -07:00
Evan Tschannen 0957b33948
Merge pull request #3107 from etschannen/feature-fast-keyserver-decode
optimized decodeKeyServersValue on the proxy when loading all key ranges on startup
2020-05-09 18:05:29 -07:00
Evan Tschannen 6fca885b9d revert strage class monitor leader because of correctness issues 2020-05-09 18:03:59 -07:00
Evan Tschannen f9518c3441
Merge pull request #3069 from alexmiller-apple/tls-connection-count
YOLO at reducing TLS connection count via doing monitorLeader on coordinators
2020-05-09 17:12:27 -07:00
Evan Tschannen 9d5e37f1a8 optimized decodeKeyServersValue on the proxy when loading all key ranges on startup 2020-05-09 16:54:35 -07:00
Evan Tschannen ebf141c84b
Merge pull request #3103 from etschannen/feature-optimize-ss
Refactored some actors in the storage server to improve performance
2020-05-09 16:35:06 -07:00
Evan Tschannen dbdf6ddbd7 removed an unnecessary try/catch 2020-05-09 16:00:36 -07:00
Andrew Noyes 8bd5dcaff8 Merge branch 'master' into atn34/special-key-versioning 2020-05-09 15:34:20 -07:00
Evan Tschannen f298436db7 made the style consistent 2020-05-09 15:17:22 -07:00
Evan Tschannen d497910fa2 fixed merge conflict 2020-05-09 13:34:51 -07:00
Evan Tschannen 69affebe40 merge master 2020-05-09 13:29:18 -07:00
Evan Tschannen 2dfae85dc7 the delay for reads is about 15% of the total cost of the read, so start multiple reads with the same delay 2020-05-09 13:26:38 -07:00
A.J. Beamon 02307ba7b6 Merge branch 'master' into transaction-tagging
# Conflicts:
#	fdbclient/DatabaseContext.h
2020-05-09 07:50:29 -07:00
Steve Atherton e4006c4b63 Apply clang-format. 2020-05-09 02:21:26 -07:00
Evan Tschannen a4fc593a3a refactored some actors in the storage server to improve performance 2020-05-08 21:08:52 -07:00
Evan Tschannen cec63f2429
Merge pull request #3101 from satherton/feature-redwood
Redwood Update - Internal page incremental updates and efficient cleared/unchanged subtree skipping
2020-05-08 19:53:42 -07:00
Andrew Noyes a53d05ea2d Fix bug and add test 2020-05-09 02:46:40 +00:00
Evan Tschannen ee0be88b99 consistency check can use a UIDtoTag map at a different version from the keyservers which could result in missing entries 2020-05-08 17:45:06 -07:00
Evan Tschannen f0f52fb2be Merge branch 'master' into feature-small-endpoint
# Conflicts:
#	fdbclient/StorageServerInterface.h
2020-05-08 16:37:35 -07:00
Evan Tschannen 8166e1af8b Storage server tags cannot change once used in the keyServer location map 2020-05-08 16:17:10 -07:00
Steve Atherton 163b291785 CommitSubtree() now skips recursing into adjacent subtrees that are uniformly cleared or unchanged very efficiently. This will be a huge reduction in CPU usage for random workloads. 2020-05-08 15:24:40 -07:00
Steve Atherton 1966dbb576 Checkpointing large refactor of how commitSubtree() works regarding internal pages such that now they can be incrementally modified and detecting changes involves far fewer comparison and staging of records. 2020-05-08 07:11:51 -07:00
Alex Miller 383099aef3 Bug fixes to get it actually doing the right thing:
* Intialize electionResult when constructing with NetworkAddress.
* Return after sending a reply.
* Reset the reply promise on each new request.
2020-05-08 01:00:18 -07:00
Andrew Noyes d75a9d0062 Don't set SPECIAL_KEY_SPACE_RELAXED for test within one module 2020-05-08 05:37:37 +00:00
Andrew Noyes 1f40b552f6 Update existing usages of worker_interfaces to new format 2020-05-08 05:37:37 +00:00
Andrew Noyes ce0e03a800 Add virtual destructor to SpecialKeyRangeBaseImpl 2020-05-08 05:37:37 +00:00
Andrew Noyes c4288d698c Update tests to understand SPECIAL_KEY_SPACE_RELAXED 2020-05-08 05:37:37 +00:00