Commit Graph

8501 Commits

Author SHA1 Message Date
Meng Xu 3e6bbe9e5b FastRestore:Applier:Use real size for atomic op 2020-02-11 15:51:32 -08:00
Meng Xu cda8fc189e FastRestore:AtomicOp:Intro weighted size for atomicOp
atomicOp has an amplified performance overhead to the cluster,
for example, an ADD operation can be small, but SS has to load
the value to do the operation and the value can be large.
2020-02-11 12:48:05 -08:00
Daniel Smith 7eec4248a6 Merge branch 'master' into moar-branches 2020-02-11 15:26:13 -05:00
Daniel Smith e715e61caa
Merge pull request #3 from apple/master
Merge upstream
2020-02-11 15:21:48 -05:00
Meng Xu e76b6d824a FastRestore:Assign priority to actors to prioritize vb work
When we pipeline multiple version batches, we should prevent a later
version batch from blocking the earlier version batch by consuming
CPU resources.

To achive the above, we should assign higher priority to actors
in later phases in a version batch.

Because restore master will not invoke an actor at a later phase unless
the actors at the earlier phases have been finished. This priority assignment
will not cause dead lock.
2020-02-10 20:29:23 -08:00
mpilman 752d95e81b updated old release notes 2020-02-10 17:27:11 -08:00
Meng Xu 325bd52939 FastRestore:Applier:Count appliedTxns 2020-02-10 17:13:20 -08:00
Meng Xu 0c5997ca2d FastRestore:Add more traces 2020-02-10 17:01:59 -08:00
Meng Xu ad93e7bb0c FastRestore:Metrics:Minor change on trace name 2020-02-10 16:52:56 -08:00
Meng Xu dbce1e9974 FastRestore:Applier:Add metrics counter and proc counter 2020-02-10 16:38:26 -08:00
Jingyu Zhou a13d4e9bb6 Attempt to fix: remove dead code and add a unit test 2020-02-10 15:40:19 -08:00
mpilman f6dc7ba3df Fixed merge problem with release notes 2020-02-10 15:00:22 -08:00
A.J. Beamon 36d87c60b5
Merge pull request #2659 from mpilman/features/ignore-clangd
Add .cland to .gitignore
2020-02-10 14:24:50 -08:00
mpilman 7daab03ca2 Add .cland to .gitignore 2020-02-10 11:24:40 -08:00
Daniel Smith 3d253284ba Merge branch 'operator-test' into moar-branches 2020-02-10 14:08:25 -05:00
Daniel Smith 2e9828d442 Actually run the test 2020-02-10 13:55:04 -05:00
Daniel Smith 0cba81470e Fix compilation issue 2020-02-10 13:48:34 -05:00
mpilman 5a9d420cb7 Merge remote-tracking branch 'upstream/release-6.2' into release-merges/20200210 2020-02-10 10:02:05 -08:00
A.J. Beamon ff44bd2b33
Merge pull request #2639 from atn34/atn34/include-port-in-address-default
Enable include_port_in_address by default for api version 700
2020-02-10 09:50:59 -08:00
Daniel Smith 7cbf840ded Merge branch 'branch-removal' into operator-test 2020-02-10 12:48:53 -05:00
Daniel Smith 3c4b93650d Add some tests for operator<() 2020-02-10 12:47:06 -05:00
Meng Xu 27f4549aff
Merge pull request #2657 from ajbeamon/trace-field-rename
Clarify the names of a couple trace fields
2020-02-10 09:38:15 -08:00
Daniel Smith 2c1371eb9c Fix operator<() for reads/writes/etc 2020-02-10 12:27:32 -05:00
A.J. Beamon 6e31802498
Merge pull request #1732 from mpilman/features/icc
FDB compiling with icc (non-functional) - some code cleanup
2020-02-10 08:19:57 -08:00
A.J. Beamon b8a252da40 Clarify the names of a couple trace fields 2020-02-10 08:15:00 -08:00
Alvin Moore d45fbbf4c2
Merge pull request #2656 from mpilman/bugfixes/slow-windows-6.2
Several build improvements - enables parallel builds on Windows (again)
2020-02-10 07:28:26 -08:00
Meng Xu 1fc793d6a7 FastRestore:Loader:Add metrics counter 2020-02-09 22:06:14 -08:00
Meng Xu fd5b4af05a FastRestore:Add trace for each phase on master 2020-02-09 18:54:10 -08:00
mpilman 0a7116444f Make compile commands target work on Windows 2020-02-09 08:34:52 -08:00
mpilman 5c294e2646 Several build improvements - enables parallel builds on Windows (again) 2020-02-09 08:34:14 -08:00
Markus Pilman e71fe44ee3
Merge branch 'master' into features/icc 2020-02-08 21:33:02 -08:00
Saurabh Chaturvedi 3c47d3bce2 Remove obsolete virtualenv constants from Makefile 2020-02-09 03:35:56 +05:30
Saurabh Chaturvedi ed9df1e6bd Port documentation to build via Python3 2020-02-09 03:27:26 +05:30
Daniel Smith 6ede94f2b6 Simplify operator< 2020-02-07 15:04:25 -05:00
A.J. Beamon 50bd15c970
Merge pull request #2554 from dyoungworth/dyoungworth/addVersionstampDoc2
Add versionstamp documentation
2020-02-07 10:02:30 -08:00
A.J. Beamon 725e16ded2
Merge pull request #2617 from ajbeamon/fix-storage-server-empty-commit-bug
Fix: storage server version could fail to advance in response to empty commits
2020-02-07 10:00:02 -08:00
A.J. Beamon b35506704f
Update documentation/sphinx/source/release-notes.rst
Add PR number
2020-02-07 08:58:35 -08:00
Daniel Smith 7f490de27c Merge branch 'master' into branch-removal 2020-02-07 11:45:59 -05:00
Daniel Smith 7aebe05ff9
Merge pull request #2 from apple/master
Merge upstream
2020-02-07 11:43:53 -05:00
Meng Xu 9b7a00a64f FastRestore:Mute trace when apply to db 2020-02-06 20:52:24 -08:00
Meng Xu dc848f4297 FastRestore:Disable verbose trace for perf. measurement 2020-02-06 20:50:23 -08:00
Meng Xu 72110de7e2 FastRestore:Add trace for quick perf. measurement 2020-02-06 19:48:26 -08:00
David Youngworth c40446f651 Tweak versionstamp documentation 2020-02-06 16:07:07 -08:00
Evan Tschannen 2d4f24ac48
Merge pull request #2645 from Daniel-B-Smith/only-one-conflict
Only use one MiniConflictSet
2020-02-06 15:55:09 -08:00
Meng Xu cf331b9a03 FastRestore:monitorFinishedVersion for measuring perf quickly 2020-02-05 14:26:25 -08:00
Evan Tschannen 844c8511c4
Merge pull request #2588 from jzhou77/backup-worker
Integrate new backup worker with existing backup command
2020-02-05 14:14:43 -08:00
Jingyu Zhou c43ac4c38f Backup worker: Construct range map on-demand
This is to reduce the number of map lookups in the original code.
2020-02-05 11:47:05 -08:00
Jingyu Zhou d5849af5c0 Address review comments 2020-02-05 10:33:51 -08:00
Daniel Smith fc695f364c Remove bool field always set to false 2020-02-05 11:08:41 -05:00
Andrew Noyes fcefb4bf6d
Merge branch 'master' into issue-1226 2020-02-04 17:46:36 -08:00