9408915ab9
reformat code
2020-04-06 13:38:18 -07:00
33780fc16e
reformat code
2020-04-06 13:23:41 -07:00
03795cc6b8
delete commented code
2020-04-06 11:42:31 -07:00
aad8f850f3
refactor conflicting keys feature using special key space
2020-04-04 13:26:11 -07:00
a93c0053ca
add two asserts
2020-04-03 19:09:12 -07:00
5b6ae4da7f
A simple intergration to put conflictingKeys into special-key-space
2020-04-03 16:11:20 -07:00
b76baa9cc2
Update conflicting keys related constants
2020-04-03 16:08:57 -07:00
36bf2ecf4c
add \xff\xff prefix to returned keys
2020-04-03 00:26:11 -07:00
81dd97d27f
Change special keyspace to \xff\xff, \xff\xff\xff
2020-03-31 19:06:45 -07:00
393cbabd52
Rename class
2020-03-31 19:06:11 -07:00
debbe648e8
Use specialkeys
2020-03-31 19:05:47 -07:00
c8abd9c493
Reformat some code
2020-03-31 18:53:36 -07:00
863ebc2d6d
fix merge conflict
2020-03-31 18:49:59 -07:00
a63f8b839c
Merge remote-tracking branch 'upstream/master' into private-keyspace-framework
2020-03-31 12:05:42 -07:00
8e489e7031
Merge pull request #2870 from dongxinEric/feature/2399/provide-comprehensive-info-about-exclude-in-fdbcli
...
Instead of providing partial information about exclude results in dif…
2020-03-31 11:58:41 -07:00
18356ec4e6
Apply suggestions from code review
...
Co-Authored-By: John Brownlee <mail@johnbrownlee.com>
2020-03-31 11:11:24 -07:00
82a2196d7d
update space range
2020-03-31 09:34:53 -07:00
9d1e4ec66c
refine part of the code
2020-03-31 09:33:25 -07:00
09a5629114
Merge pull request #2883 from tclinken/add-getversion-command
...
Added fdbcli getversion command
2020-03-31 07:56:15 -07:00
1d790346c9
refine part of the code
2020-03-31 01:44:02 -07:00
53a04740be
refine part of the code
2020-03-31 01:36:07 -07:00
2a0bb34005
delete code and format
2020-03-31 01:21:21 -07:00
79db3b2a57
add randomness
2020-03-31 01:14:35 -07:00
3640dfed99
add trace lines fore test failures
2020-03-31 00:09:38 -07:00
37ca0bf7e2
add code to handle the three flags in RangeResultRef
2020-03-30 23:27:09 -07:00
42df1e7792
Merge pull request #2879 from jzhou77/backup-progress
...
Update mutation bytes written for new backups
2020-03-30 21:42:45 -07:00
a85652375c
Merge pull request #2872 from jzhou77/backup-fix
...
Switch off old mutation logging on proxies for new backups
2020-03-30 21:42:10 -07:00
60f6edc3b5
Merge pull request #2860 from zjuLcg/report-conflicting-key-roll-forward
...
Report conflicting key roll forward
2020-03-30 17:33:56 -07:00
bee6acb717
Added fdbcli getversion command
2020-03-30 17:12:52 -07:00
3c76722504
Fix valgrind error of invalid memory access
2020-03-30 16:38:22 -07:00
3c32835cce
Fix decoder for unfinished version batch in a log
...
A mutation log's version batch data can be split into multiple blocks, and some
of the blocks can be spread across two mutation logs. Thus, the decoder needs
copy unfinished version batch data from previous file progress to the next one.
2020-03-30 11:34:51 -07:00
f92ef730a4
Merge pull request #2876 from mpilman/bugfixes/cmake-env-set
...
Introduce `set_env` function
2020-03-30 02:13:53 -07:00
411b4c28ac
Update mutation bytes written for new backups
...
This will make the log bytes written available to backup status and describe
backup calls.
2020-03-29 21:23:34 -07:00
65e3b9192e
Add an assert for probably dead code
2020-03-28 21:19:47 -07:00
241f9c123e
Try to find continuous log ranges that cover snapshot begin version
...
Backup container can have mutation log files that are not continuous overall,
but contain a continuous range that cover the snapshots. So when determine the
continuous log ranges, try to find one that cover the first snapshot's begin
version.
2020-03-28 21:19:47 -07:00
280bc94738
Do not recruit backup workers with wrong tags
...
In a rare scenario, the master can recruit backup workers with more tags than
the number of log router tags for an epoch. This can be caused by an
unsuccessful recovery, which uses more tags than the next epoch. When
recruiting for the next epoch, if no progress has been made yet, the recruiting
logic will look back at the previous epoch. If previous epoch has saved past
this epoch's begin version, current epoch's progress is updated with that
information and can result in more tags being inserted to this epoch's
recruitment.
2020-03-28 21:19:41 -07:00
3261eae8c1
Initialize contiguousLogEnd to the lowest possible version
...
If set to the first file's end version, then we may erroneously set to an
unrestorable version.
2020-03-28 17:38:02 -07:00
34745d71fa
Fix continuous end version
...
When scan from a known version, stop if logs are not continuous. However, if
scan from 0, we should reset minLogBegin to the next file and continue scan
from that file's begin version.
2020-03-28 17:38:02 -07:00
abcb458a44
Fix contiguousLogEnd calculation
...
The contiguous version should scan from the max of scanBegin version and the
minLogBegin version. Once we found a version that's larger, set it as the
contiguousLogEnd version.
2020-03-28 17:38:02 -07:00
efbd01894d
Really fix the stuck of backup
2020-03-28 17:38:02 -07:00
f0d0c863e6
Attempt to fix
2020-03-28 17:38:02 -07:00
78f74ed6fe
Skip copying inside BackupLogsDispatchTask
2020-03-28 17:38:02 -07:00
a2b8be5dc6
Switch off old mutation logging on proxies for new backups
...
Specifically, stop writing LogRange mutation for new backup jobs.
2020-03-28 17:38:02 -07:00
cf7404a771
Merge pull request #2871 from xumengpanda/mengxu/parallel-range-log-file-loading-PR
...
Performant restore [24/xx]: Process range and log files in parallel for old backup format
2020-03-28 17:33:50 -07:00
92998d3df9
Add restore with old backup tests into CMakeLists
2020-03-28 16:08:22 -07:00
13f343ec96
Resolve minor review comment
2020-03-28 16:03:01 -07:00
6e60c62d7b
Add ParallelRestoreCorrectnessAtomicOp.txt
2020-03-28 16:00:51 -07:00
8a30526336
FastRestore:Remove commented assertion
2020-03-28 13:11:32 -07:00
404a3e2619
FastRestore:Loader:Remove sanity chech for the order of sending log and range mutations
2020-03-27 23:36:13 -07:00
21a5c67f9a
FastRestore:Remove assertion on mutation sending order
2020-03-27 17:09:31 -07:00
chaoguang