Commit Graph

3500 Commits

Author SHA1 Message Date
Meng Xu 132f5aa9ba FastRestore:Improve trace name and cosmetic change 2020-02-18 16:41:19 -08:00
Meng Xu 31a6ec34b7 Merge branch 'master' into mengxu/fast-restore-agent-PR 2020-02-18 16:17:59 -08:00
Meng Xu a12a161fb3 Merge branch 'master' into mengxu/fast-restore-pipeline-PR 2020-02-18 14:49:52 -08:00
Meng Xu c603b20e7e FastRestore:Resolve review comments 2020-02-18 14:08:27 -08:00
Balachandar Namasivayam d5ce9ec924
Merge pull request #2690 from bnamasivayam/master
Fix an incorrect if else check.
2020-02-17 18:35:37 -08:00
Balachandar Namasivayam 1be6915a38 Fix an incorrect if else check. 2020-02-17 17:31:41 -08:00
Alex Miller 78f20398f1
Merge pull request #2671 from Daniel-B-Smith/moar-branches
Remove more branches from KeyInfo comparisons
2020-02-17 17:13:09 -08:00
Alex Miller 9144c3e8ca
Merge pull request #2087 from atn34/issue-1226
Allow member actors access to private variables
2020-02-17 14:39:31 -08:00
Meng Xu b81e2e0e1d
Merge pull request #2685 from jzhou77/backup-fix
Fix key_not_found error due to deleted BackupConfig
2020-02-15 21:45:01 -08:00
Jingyu Zhou 9e4668d656 Fix key_not_found error due to deleted BackupConfig
Since backup worker doesn't catch this error, a deleted BackupConfig can cause
the backup worker to get key_not_found error. Fix by adding a check if the
container can be found.
2020-02-14 19:37:58 -08:00
Alex Miller 94e7f790d8
Merge pull request #2667 from atn34/atn34/remove-flatbuffers-knob
Remove USE_OBJECT_SERIALIZER knob
2020-02-14 15:44:38 -08:00
Meng Xu 9d445b36c6
Merge pull request #2674 from jzhou77/valgrind-fix
Fix valgrind error on backup workers
2020-02-12 21:58:36 -08:00
Jingyu Zhou 471d903862 Fix valgrind error: change from BinaryReader to ArenaReader 2020-02-12 16:57:56 -08:00
Balachandar Namasivayam 32165c506f Fix a one line bug where the if check comparison was wrong. 2020-02-12 16:55:33 -08:00
Alex Miller 7a0bd1a81a
Merge pull request #2648 from Daniel-B-Smith/branch-removal
Remove an unnecessary branch
2020-02-12 14:36:44 -08:00
Jingyu Zhou b4aa36b651 Really fix valgrind error: erase messages after saved to files 2020-02-12 11:43:14 -08:00
Meng Xu 1e2211a429 FastRestore:Master:Record lowerBoundKey when split keyrange for appliers 2020-02-12 11:20:53 -08:00
Andrew Noyes 1248d2b8b4 Remove USE_OBJECT_SERIALIZER knob 2020-02-12 10:41:52 -08:00
Jingyu Zhou 237f0c35cd Add mutations state variable to hold on to memory 2020-02-12 10:02:27 -08:00
Meng Xu 3e6bbe9e5b FastRestore:Applier:Use real size for atomic op 2020-02-11 15:51:32 -08:00
Meng Xu cda8fc189e FastRestore:AtomicOp:Intro weighted size for atomicOp
atomicOp has an amplified performance overhead to the cluster,
for example, an ADD operation can be small, but SS has to load
the value to do the operation and the value can be large.
2020-02-11 12:48:05 -08:00
Daniel Smith 7eec4248a6 Merge branch 'master' into moar-branches 2020-02-11 15:26:13 -05:00
Meng Xu e76b6d824a FastRestore:Assign priority to actors to prioritize vb work
When we pipeline multiple version batches, we should prevent a later
version batch from blocking the earlier version batch by consuming
CPU resources.

To achive the above, we should assign higher priority to actors
in later phases in a version batch.

Because restore master will not invoke an actor at a later phase unless
the actors at the earlier phases have been finished. This priority assignment
will not cause dead lock.
2020-02-10 20:29:23 -08:00
Meng Xu 325bd52939 FastRestore:Applier:Count appliedTxns 2020-02-10 17:13:20 -08:00
Meng Xu 0c5997ca2d FastRestore:Add more traces 2020-02-10 17:01:59 -08:00
Meng Xu ad93e7bb0c FastRestore:Metrics:Minor change on trace name 2020-02-10 16:52:56 -08:00
Meng Xu dbce1e9974 FastRestore:Applier:Add metrics counter and proc counter 2020-02-10 16:38:26 -08:00
Jingyu Zhou a13d4e9bb6 Attempt to fix: remove dead code and add a unit test 2020-02-10 15:40:19 -08:00
Daniel Smith 3d253284ba Merge branch 'operator-test' into moar-branches 2020-02-10 14:08:25 -05:00
Daniel Smith 2e9828d442 Actually run the test 2020-02-10 13:55:04 -05:00
Daniel Smith 0cba81470e Fix compilation issue 2020-02-10 13:48:34 -05:00
mpilman 5a9d420cb7 Merge remote-tracking branch 'upstream/release-6.2' into release-merges/20200210 2020-02-10 10:02:05 -08:00
A.J. Beamon ff44bd2b33
Merge pull request #2639 from atn34/atn34/include-port-in-address-default
Enable include_port_in_address by default for api version 700
2020-02-10 09:50:59 -08:00
Daniel Smith 7cbf840ded Merge branch 'branch-removal' into operator-test 2020-02-10 12:48:53 -05:00
Daniel Smith 3c4b93650d Add some tests for operator<() 2020-02-10 12:47:06 -05:00
Daniel Smith 2c1371eb9c Fix operator<() for reads/writes/etc 2020-02-10 12:27:32 -05:00
A.J. Beamon b8a252da40 Clarify the names of a couple trace fields 2020-02-10 08:15:00 -08:00
Meng Xu 1fc793d6a7 FastRestore:Loader:Add metrics counter 2020-02-09 22:06:14 -08:00
Meng Xu fd5b4af05a FastRestore:Add trace for each phase on master 2020-02-09 18:54:10 -08:00
Markus Pilman e71fe44ee3
Merge branch 'master' into features/icc 2020-02-08 21:33:02 -08:00
Daniel Smith 6ede94f2b6 Simplify operator< 2020-02-07 15:04:25 -05:00
Daniel Smith 7f490de27c Merge branch 'master' into branch-removal 2020-02-07 11:45:59 -05:00
Meng Xu 9b7a00a64f FastRestore:Mute trace when apply to db 2020-02-06 20:52:24 -08:00
Meng Xu dc848f4297 FastRestore:Disable verbose trace for perf. measurement 2020-02-06 20:50:23 -08:00
Meng Xu 72110de7e2 FastRestore:Add trace for quick perf. measurement 2020-02-06 19:48:26 -08:00
Evan Tschannen 2d4f24ac48
Merge pull request #2645 from Daniel-B-Smith/only-one-conflict
Only use one MiniConflictSet
2020-02-06 15:55:09 -08:00
Meng Xu cf331b9a03 FastRestore:monitorFinishedVersion for measuring perf quickly 2020-02-05 14:26:25 -08:00
Evan Tschannen 844c8511c4
Merge pull request #2588 from jzhou77/backup-worker
Integrate new backup worker with existing backup command
2020-02-05 14:14:43 -08:00
Jingyu Zhou c43ac4c38f Backup worker: Construct range map on-demand
This is to reduce the number of map lookups in the original code.
2020-02-05 11:47:05 -08:00
Jingyu Zhou d5849af5c0 Address review comments 2020-02-05 10:33:51 -08:00