Commit Graph

2046 Commits

Author SHA1 Message Date
Meng Xu 7b5d43da9c FastRestore:Remove unused field in RestoreRequest 2020-05-03 20:59:47 -07:00
Jingyu Zhou 488bbcf33d
Merge pull request #2952 from xumengpanda/mengxu/fr-code-improvement-PR
Performant restore [29/XX]: Improve coding style and efficiency
2020-05-01 20:32:11 -07:00
A.J. Beamon 9294f3ef4a
Merge pull request #3067 from atn34/atn34/set-versionstamped-key-no-ryw
Test SetVersionstampedKey without ryw enabled
2020-05-01 18:37:31 -07:00
Steve Atherton 175bdc842f
Merge pull request #3066 from tclinken/remove-dead-backup-agent-code
Remove dead backup agent code
2020-05-01 17:17:29 -07:00
tclinken aca995d2c5 Removed dead backup agent code 2020-05-01 14:46:59 -07:00
Andrew Noyes 7edbbb642e Test SetVersionstampedKey without ryw enabled 2020-05-01 20:58:37 +00:00
Vishesh Yadav c7cc546d80 build: Remove fdbclient/fdbclient.vcxproj
vcxproj files are unnecessary after CMake switch.
2020-05-01 12:33:46 -07:00
Evan Tschannen bd699f435c fixed compiler errors 2020-05-01 11:01:09 -07:00
Meng Xu 038f3834fc Merge branch 'master' into mengxu/fr-code-improvement-PR 2020-05-01 09:26:29 -07:00
Evan Tschannen aed2d34bcb Merge branch 'master' into feature-proxy-load-balance
# Conflicts:
#	fdbclient/NativeAPI.actor.cpp
#	fdbserver/MasterProxyServer.actor.cpp
#	flow/Knobs.cpp
2020-05-01 09:19:39 -07:00
Jingyu Zhou b3698ac921
Merge pull request #3060 from xumengpanda/mengxu/fr-agent-fix-PR
Fix fastrestore_agent errors when run in non-simulation mode
2020-04-30 22:46:39 -07:00
Jingyu Zhou ee104a116f
Merge pull request #3059 from xumengpanda/mengxu/too-many-files-fix-v2
Fix:Disable sanity check backup-metadata file
2020-04-30 16:41:40 -07:00
Meng Xu 07a9a05683 FastRestore:Agent:Fix restore requests 2020-04-30 16:20:20 -07:00
Meng Xu 6ee78aa3a4 Fix:Disable sanity check backup metadata file
Which can increase the false positive rate of TooManyFiles error
2020-04-30 16:16:14 -07:00
Evan Tschannen c14133a4ec better serialization of empty StringRef 2020-04-30 11:13:59 -07:00
Meng Xu a0d67cac16 Merge branch 'master' into mengxu/fr-code-improvement-PR 2020-04-29 21:07:33 -07:00
Evan Tschannen 0861785e80 Merge branch 'master' into feature-efficient-single-keyrange 2020-04-29 18:49:20 -07:00
Evan Tschannen f4af745a18 Merge branch 'master' into feature-tree-broadcast 2020-04-29 17:49:57 -07:00
Meng Xu a998fa1e1a
Merge pull request #3053 from xumengpanda/mengxu/fr-bc-fix-PR
Fix performant restore bug introduced in PR 3041
2020-04-29 17:09:26 -07:00
Meng Xu 3f510d0653
Merge pull request #3036 from jzhou77/backup-cmd
Several bug fixes for new backups
2020-04-29 16:34:59 -07:00
Meng Xu 84ca9c9176 Merge branch 'master' into mengxu/fr-bc-fix-PR 2020-04-29 16:25:12 -07:00
Jingyu Zhou 9da76c35ea Fix a memory corruption error
The backup container URL should be Key instead of KeyRef.
2020-04-29 15:55:34 -07:00
Evan Tschannen 519ac70a2a
Revert "Enable -Wclass-memaccess and fix warnings" 2020-04-29 15:51:29 -07:00
Meng Xu 33dedaab35 FastRestore:Fix submitParallelRestore when targetVersion is unset 2020-04-29 15:44:54 -07:00
Evan Tschannen e7ab47b60d Merge branch 'master' into feature-tree-broadcast 2020-04-29 14:35:42 -07:00
Evan Tschannen 0420b3e786 fix compile error 2020-04-29 14:05:53 -07:00
Evan Tschannen 7cebe743f9 A number of bug fixes of rare correctness errors 2020-04-29 13:50:13 -07:00
Evan Tschannen 627eb93dd9
Merge pull request #2941 from etschannen/feature-tree-broadcast
Implemented a tree broadcast for the proxy and cluster controller
2020-04-29 13:38:09 -07:00
Evan Tschannen 6156042f67
Merge pull request #3017 from tclinken/enable-wclass-memaccess
Enable -Wclass-memaccess and fix warnings
2020-04-29 10:38:59 -07:00
Evan Tschannen 76fb345dd1 Merge branch 'master' into feature-tree-broadcast
# Conflicts:
#	fdbrpc/FailureMonitor.actor.cpp
2020-04-29 09:51:22 -07:00
Jingyu Zhou a8becb9027 Use calculated block size for range files in unit tests 2020-04-28 21:13:18 -07:00
Jingyu Zhou f4010c632a
Merge pull request #3041 from xumengpanda/mengxu/sim-restore-agent
Performant restore [31/xx]: Fix for fast restore agent
2020-04-28 20:28:18 -07:00
chaoguang 3adbc89510 update special-key-space argument 2020-04-28 16:50:24 -07:00
chaoguang a69dda4263 Merge remote-tracking branch 'upstream/master' into private-keyspace-framework 2020-04-28 16:33:35 -07:00
chaoguang 562456028c Fix the interface of special-key-space, only keys in (\xff\xff, \xff\xff\xff) are valid 2020-04-28 16:33:10 -07:00
Jingyu Zhou 364142d02c Fix backupWorkerEnabled flag not set bug for first backup
This can cause restore failures because the latestLogEndVersion could be wrong.
2020-04-28 15:39:24 -07:00
Jingyu Zhou ba261eda36 Fix a backup container unit test
Write a valid range file instead of random data so that checking its content is
fine.
2020-04-28 15:39:24 -07:00
Jingyu Zhou 7d59e53349 Consolidate makePadding() 2020-04-28 15:39:23 -07:00
Jingyu Zhou b315163033 Fix a memory corruption error 2020-04-28 15:39:23 -07:00
Evan Tschannen b7f5f3be48 merge in master 2020-04-28 13:11:47 -07:00
Meng Xu f5e8345496 FastRestoreAgent:Use atomicParallelRestore to kick off restore
Replace the handcrafted version with atomicParallelRestore actor
which is simulation tested
2020-04-27 22:15:00 -07:00
Evan Tschannen 3fb91e8f0c
Merge pull request #3016 from etschannen/master
Merge release 6.2 into master
2020-04-23 15:44:47 -07:00
Meng Xu 59217ddf1e Remove sanity check on metadata
The sanity check parses each range file to get the key range of each
range file.
The parsing incurs restore_unsupported_file_version error.

We need to include this sanity check before 6.3 release.
2020-04-23 14:59:58 -07:00
Evan Tschannen c87aa33941 Merge branch 'release-6.2'
# Conflicts:
#	CMakeLists.txt
#	bindings/go/src/fdb/generated.go
#	documentation/sphinx/source/api-common.rst.inc
#	documentation/sphinx/source/api-ruby.rst
#	documentation/sphinx/source/release-notes.rst
#	fdbclient/FailureMonitorClient.actor.cpp
#	fdbclient/NativeAPI.actor.cpp
#	fdbclient/vexillographer/fdb.options
#	fdbrpc/FlowTransport.actor.cpp
#	fdbserver/OldTLogServer_6_0.actor.cpp
#	fdbserver/TLogServer.actor.cpp
#	fdbserver/fdbserver.actor.cpp
#	versions.target
2020-04-23 13:47:53 -07:00
Evan Tschannen 76d4570d5d
Merge pull request #3008 from etschannen/release-6.2
Added logging for parallel peeks from TLogs
2020-04-23 10:27:49 -07:00
Evan Tschannen 37f9456010 added logging when encountering an inverted range 2020-04-22 23:37:29 -07:00
Evan Tschannen 810bba2067 cleanup calls to FlowTransport::isClient() 2020-04-22 23:36:40 -07:00
Evan Tschannen 0c84ad4bc6
Merge pull request #2917 from bnamasivayam/fail-slow-ss
Mark the storage servers that are continually lagging as unhealthy
2020-04-22 23:18:35 -07:00
tclinken b1f525583a Added -Wclass-memaccess compiler option and fixed warnings 2020-04-22 21:53:42 -07:00
Meng Xu 38193a3866 Merge branch 'master' into mengxu/fr-code-improvement-PR 2020-04-22 10:51:33 -07:00