5893f66ced
FastRestore:Deduplicate backup range and log files
2020-01-21 21:55:02 -08:00
4fbbff8ccd
FastRestore:Cannot rely on default enum value
...
enum class value does not have a standard default value.
We cannot assume the default value is 0 for scala enum type.
2020-01-21 21:43:32 -08:00
009fcdeb16
FastRestore:Sanity check each restore asset is processed exactly once
2020-01-21 17:17:45 -08:00
022783b449
Start batches in reverse order for testings and code cleanup
2020-01-21 14:49:40 -08:00
4ac92d223b
Cleanup batch buffer for each restore request
2020-01-21 14:49:36 -08:00
e933716109
FastRestore:Enable multiple batch pipelining
2020-01-17 17:01:09 -08:00
1a130b0df3
FastRestore:Fix race condition on handleApplyToDBRequest
2020-01-17 17:01:09 -08:00
8d3f3aa926
FastRestore:Pipeline multiple version batches
2020-01-17 17:01:06 -08:00
441f3e2814
FastRestore:Master buffer data and progress for each batch
2020-01-17 17:01:06 -08:00
d69bd2f661
FastRestore:Loader buffer data for multiple batches
2020-01-17 17:01:06 -08:00
bfbf2164c4
FastRestore:Applier buffer data for multiple batches
2020-01-17 17:01:01 -08:00
35bc92b9a4
FastRestore:Refactor code to enable pipeline on Applier
2020-01-14 13:23:33 -08:00
f436ea806e
FastRestore:Resolve review comment
...
1) Sort logfiles by endVersion
2) Exit program early when restore will not succeed
3) Do not increase nextVersion unncessarily when
calculate version batches.
4) Change assert condition that ensures progress in
calculating version batches.
2020-01-13 14:08:27 -08:00
dba85d28fc
FastRestore:Cosmetic revision
2020-01-08 10:53:53 -08:00
83a572ae22
FastRestore:buildVersionBatches:remove unused variable
2020-01-07 18:24:23 -08:00
a2b26906e8
FastRestore:Filter out empty files before distributing workload
...
and clean up unused code
2020-01-07 17:01:53 -08:00
c29e380076
FastRestore:Remove prevVersion from LoadingParam
2020-01-07 14:59:17 -08:00
9df02512ab
FastRestore:Apply clang-format
2020-01-07 11:50:32 -08:00
67e913c3d5
Change LoadingParam struct and endVersion definition
...
1) Remove endVersion field because it has been included in RestoreAsset;
2) Ensure endVersion in VersionBatch and RestoreAsset is always exclusive;
3) Revise ASSERT in laoder and applier in situations when the dummy commit version
is endVersion, to avoid false positive ASSERT failure.
2020-01-07 11:48:03 -08:00
c3f8f3b445
FastRestore:Build VersionBatch less than threshold size
2020-01-07 11:46:56 -08:00
92c4a94ce7
Merge pull request #2503 from apkar/master
...
Fixing minor inaccuracy in recovery internals design doc.
2019-12-28 16:04:51 -08:00
e1b5ef2672
Fixing minor inaccuracy in recovery internals design doc.
2019-12-27 10:14:25 -08:00
45e24fc6a1
Merge pull request #2493 from xumengpanda/mengxu/fast-restore-restoreAsset-PR
...
Performant restore [13/XX]: Introduce RestoreAsset to uniquely identify the backup block to restore
2019-12-23 16:31:15 -08:00
c10035ba54
FastRestore:Use isInVersionRange based on code review
2019-12-23 15:01:27 -08:00
06e7bc061d
Merge pull request #2500 from apple/release-6.2
...
Merge Release 6.2 Into Master
2019-12-23 15:00:34 -08:00
ff965d54a1
Merge pull request #2498 from AlvinMooreSr/cmake_defines
...
CMake Variable Initialization
2019-12-23 14:04:43 -08:00
6acf04bb72
Ensured that the cmake variable is always initialized/set to some value when compared and thereby has an expected value
2019-12-23 11:50:01 -08:00
93c1810ad8
Merge pull request #2496 from apple/release-6.2
...
Merge Release 6.2 Into Master
2019-12-23 10:17:23 -08:00
e14b3ed64e
Merge pull request #2494 from AlvinMooreSr/cmake_defines
...
CMake Release Fix
2019-12-23 07:38:24 -08:00
325d553973
Set the package release version based on if the build is a release package or not like the make builds
2019-12-23 02:42:02 -08:00
3ce3e1e06e
Changed the name of the rpm packages to conform to the existing names when building release project
2019-12-22 20:11:40 -08:00
8d6f511816
FastRestore:Resolve review comment
...
Filter out range mutations that do not overlap with the restore range.
Small changes on format.
2019-12-22 20:09:10 -08:00
599571a055
Merge pull request #2491 from jzhou77/doc
...
Reformat data distributor design doc
2019-12-20 22:26:46 -08:00
61b29de3ce
FastRestore:Self code review
...
Clean up commented code;
Add sanity check.
2019-12-20 22:24:34 -08:00
ddcf3fdd80
FastRestore:Apply clang format
2019-12-20 22:00:36 -08:00
2cd1f0780a
FastRestore:Split asset to subasset for async parsing files
2019-12-20 21:44:40 -08:00
d888e3100b
FastRestore:Applier:Add invariant
2019-12-20 19:34:28 -08:00
e98b2a0d1c
FastRestore:Introduce RestoreAsset
2019-12-20 18:00:10 -08:00
c0614bc037
Merge pull request #2492 from apple/release-6.2
...
Release 6.2 Merge Into Master
2019-12-20 15:21:33 -08:00
62ffcf343f
Merge pull request #2489 from AlvinMooreSr/cmake_defines
...
Cmake Package Name Fix
2019-12-20 14:34:11 -08:00
90d7db60a8
Change bullets back to paragraphs
2019-12-20 13:12:36 -08:00
c7fc72af39
Changed the name of the java jar to conform with the existing prerelease nomenclature
2019-12-20 12:23:28 -08:00
861e23953c
More formatting updates
2019-12-20 11:55:33 -08:00
ac261f8f6a
Reformat data distributor doc
...
Remove extra spaces and highlight code.
2019-12-20 11:51:11 -08:00
35a38a3188
Merge pull request #2490 from ajbeamon/bindingtester-filter-future-version
...
Filter future_version errors in the binding tester
2019-12-20 11:42:56 -08:00
f97129e9ac
Filter future_version errors in the binding tester
2019-12-20 11:22:23 -08:00
370786c95d
Fixed package name (again)
2019-12-20 10:18:34 -08:00
cb6ab87621
Fixed the name of the rpm and deb packages
2019-12-20 09:37:24 -08:00
e226f41665
Added -PRERELEASE suffix to flow package
2019-12-20 09:36:48 -08:00
53d196070b
Merge pull request #2485 from xumengpanda/mengxu/change-StringRefReaderMX-PR-v2
...
Performant restore [12/XX add-on]: Rename StringRefReaderMX to BackupStringRefReader
2019-12-19 15:44:19 -08:00
Meng Xu