Commit Graph

11627 Commits

Author SHA1 Message Date
Evan Tschannen 2a72bc3dff
Merge pull request #3707 from etschannen/release-6.2
LastConnectTime was not being set for incoming connections
2020-08-31 10:37:23 -07:00
Evan Tschannen d42a6b6ea7 remove spammy trace event 2020-08-31 10:37:00 -07:00
Young Liu e9d1f1c9c8 change formatting 2020-08-31 09:43:11 -07:00
Young Liu b6c0299d09 Add help message in backup CLI for added options 2020-08-31 09:31:57 -07:00
Evan Tschannen fa306e07fd temporarily disable hot read detection on the storage servers because it is causing a 3% to 5% performance regression in read heavy workloads 2020-08-31 09:30:51 -07:00
Evan Tschannen 808f8309b1 disable tag_encode_key_servers because it does not help recovery times (the CPU on the proxies decoding the tags is more than the saving for the smaller size) 2020-08-31 09:29:46 -07:00
Evan Tschannen 2f5359fa13 fix: lastRunLoopBusyness did count the currently active time 2020-08-31 09:21:44 -07:00
Evan Tschannen b4a1c269b8 lastConnectTime was not being set for incomingConnections 2020-08-31 09:10:30 -07:00
Evan Tschannen 94dcedf22c
Merge pull request #3705 from etschannen/release-6.3
Merge release 6.2 into release 6.3
2020-08-31 09:07:02 -07:00
Evan Tschannen 53def68946 fix compiler warning 2020-08-31 01:23:47 -07:00
Evan Tschannen 29eec30183 Merge branch 'release-6.2' into release-6.3
# Conflicts:
#	CMakeLists.txt
#	build/Dockerfile
#	build/Dockerfile.devel
#	documentation/sphinx/source/downloads.rst
#	fdbserver/Knobs.cpp
#	fdbserver/LogSystem.h
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/TagPartitionedLogSystem.actor.cpp
#	fdbserver/WaitFailure.actor.cpp
#	fdbserver/fdbserver.vcxproj
#	fdbserver/fdbserver.vcxproj.filters
#	packaging/msi/FDBInstaller.wxs
2020-08-31 01:10:29 -07:00
Evan Tschannen 92ddf5c6d8
Merge pull request #3704 from etschannen/post-release-cleanup-6.2.25
Post release cleanup 6.2.25
2020-08-31 00:58:23 -07:00
Evan Tschannen 4e3147c95d update installer WIX GUID following release 2020-08-31 00:53:51 -07:00
Evan Tschannen ccb65b20af update version to 6.2.26 2020-08-31 00:53:51 -07:00
Evan Tschannen c08b1a84f4
Merge pull request #3694 from etschannen/release-6.2
Fixed a pathology where reopening a failed connection could take multiple seconds
2020-08-30 22:35:12 -07:00
Evan Tschannen d750ed303a fixed whitespace 2020-08-30 22:34:03 -07:00
Evan Tschannen 331a49a62a do not allow a proxy to reset a connection with the logs immediately upon starting up 2020-08-30 18:50:19 -07:00
Evan Tschannen c9ff450a36 do not reject a connection as redundant if our existing connection is more than 15 seconds old 2020-08-30 18:49:49 -07:00
Young Liu 30e27ba27b Add support for keys in CLI 2020-08-30 00:44:17 -07:00
Steve Atherton 89ae0aaf39 In Redwood unit test, if the verify actor falls far behind the latest commit version it will unnecessarily verify the latest version repeatedly which extends the test's run time needlessly. 2020-08-29 23:47:54 -07:00
Young Liu 33aa10b461 Minor optimizations 2020-08-29 20:10:45 -07:00
Young Liu fd7198d874 Extend backup container interface to support query restorable files set by key ranges 2020-08-29 19:58:07 -07:00
Steve Atherton 167d3c5a8f To avoid running too long, the Redwood correctness unit test now limits the size of the KV verification map. This map only grows as the test runs, as it contains a record for every key set or clear committed during the test. 2020-08-29 16:44:38 -07:00
Evan Tschannen f6f9aea09e fix: runLoopBusyness was always zero 2020-08-28 09:29:54 -07:00
Evan Tschannen ce1139e588 added missing dumpToken trace events 2020-08-27 17:17:27 -07:00
Evan Tschannen 86cba16d7d Added logging whenever a wait failure client triggers 2020-08-27 17:07:05 -07:00
Xin Dong 5cce9647e3
Merge pull request #3650 from xumengpanda/mengxu/fr-sched-PR
Fast Restore: Add request scheduler to increase system throughput
2020-08-27 17:04:35 -07:00
Meng Xu ca9b1f5b34 Merge branch 'release-6.3' into mengxu/fr-sched-PR
Resolve conflict at BackupContainer.actor.cpp
2020-08-27 16:54:00 -07:00
Alec Grieser 99127198d1
Merge pull request #3681 from vishesh/task/issue-3370-GetRange-DirectBuffers
java-bindings: Use DirectByteBuffer for `getRange` requests
2020-08-27 15:09:49 -07:00
Vishesh Yadav 973a9b2423 java-bindings: More typo fix 2020-08-27 14:21:46 -07:00
Vishesh Yadav 775cf06574 java-bindings: Javadoc typo fixes 2020-08-27 14:07:44 -07:00
Vishesh Yadav c103dc3ec9
Update bindings/java/src/main/com/apple/foundationdb/FDB.java
Co-authored-by: Alec Grieser <alloc@apple.com>
2020-08-27 14:01:02 -07:00
Evan Tschannen 81d8c0c263
Merge pull request #3695 from xumengpanda/mengxu/fix-fileopen-PR
Mitigate TOO_MANY_FILES error
2020-08-27 11:33:17 -07:00
Vishesh Yadav aa326c030b java-bindings: Changes per review comments
- Add function to check if DirectBuffer queries are enabled.
- Javadoc comment fixes
- Fix min buffer limits.
2020-08-27 11:14:58 -07:00
Meng Xu ca486fdcd4 FastRestoreOldBackupTest:Revert workload time to 30s 2020-08-27 09:31:57 -07:00
Vishesh Yadav b3432c0ce0 java-bindings: Addressed review comments
- Change DirectBufferPool constructor to take ByteBuffer
- Moved enableDirectBufferQueries() to public FDB class.
- Handle the edge case in resize() when called in middle of oudstanding queries.
- Don't count space need to store all KV pairs in JNI.
2020-08-26 22:33:59 -07:00
Meng Xu 369000a125 BackupContainer:Remove link to filename with random string 2020-08-26 15:55:36 -07:00
Meng Xu a2ab709a0c BackupContainer:Use processId as the process filename
instead of using a randomly generated string which change every time
when a file is open.

Having too many files will trigger TOO_MANY_FILES error
2020-08-26 15:54:34 -07:00
Meng Xu 7a29a3157f FastRestore:Fix various bugs discovered by enhanced simulation
1. sendMutation request can be dispatched when the version batch has finished and its data has been deleted;
2. Request scheduler on loader may get into infinite loop because FASTRESTORE_SCHED_LOAD_REQ_BATCHSIZE knob can be set to 0 in simulation
2020-08-26 15:53:18 -07:00
Evan Tschannen 1e817c4b4f Updated documentation for 6.2.25 2020-08-26 12:40:32 -07:00
Evan Tschannen 74edf61745
Merge pull request #3674 from sfc-gh-anoyes/anoyes/read-conflict-dbLocked
Add read conflict on \xff/dbLocked
2020-08-26 12:18:42 -07:00
Evan Tschannen d469b879ce
Merge pull request #3686 from etschannen/feature-reset-commit
Track tlog push latencies and reset connections if they are above 500ms
2020-08-26 12:17:42 -07:00
Evan Tschannen 507c67c930 Added additional information to trace events 2020-08-26 11:42:23 -07:00
Evan Tschannen 28cb5f242c another fix 2020-08-26 11:01:40 -07:00
Evan Tschannen e81ccd2dc9 another compiler fix 2020-08-26 10:59:06 -07:00
Evan Tschannen e531046b53 fix compiler errors 2020-08-26 10:56:21 -07:00
Evan Tschannen fd1a4304fa fix: made ConnectionResetInfo reference counted 2020-08-26 10:53:17 -07:00
Meng Xu f1bd2a18ed Resovle review comments: No functional change 2020-08-26 10:30:31 -07:00
Meng Xu 3d2b18b663 FastRestore:AtomicRestore:Add resetDBTimeout option 2020-08-26 10:21:17 -07:00
Meng Xu 3ca1359e89 FastRestore:Simulate cpu busy and adjust simulation of overused memory usage
Increase the chance of cpu busy and memory overused
2020-08-26 10:07:49 -07:00