Commit Graph

7906 Commits

Author SHA1 Message Date
John Brownlee 41fc724eaf
Merge pull request #2465 from PierreZ/samples/golang
Add a docker-compose go sample (#2404)
2020-01-03 13:53:09 -05:00
Meng Xu 92c4a94ce7
Merge pull request #2503 from apkar/master
Fixing minor inaccuracy in recovery internals design doc.
2019-12-28 16:04:51 -08:00
Bhaskar Muppana e1b5ef2672 Fixing minor inaccuracy in recovery internals design doc. 2019-12-27 10:14:25 -08:00
Jingyu Zhou 45e24fc6a1
Merge pull request #2493 from xumengpanda/mengxu/fast-restore-restoreAsset-PR
Performant restore [13/XX]: Introduce RestoreAsset to uniquely identify the backup block to restore
2019-12-23 16:31:15 -08:00
Meng Xu c10035ba54 FastRestore:Use isInVersionRange based on code review 2019-12-23 15:01:27 -08:00
Alvin Moore 06e7bc061d
Merge pull request #2500 from apple/release-6.2
Merge Release 6.2 Into Master
2019-12-23 15:00:34 -08:00
Alvin Moore ff965d54a1
Merge pull request #2498 from AlvinMooreSr/cmake_defines
CMake Variable Initialization
2019-12-23 14:04:43 -08:00
Alvin Moore 6acf04bb72 Ensured that the cmake variable is always initialized/set to some value when compared and thereby has an expected value 2019-12-23 11:50:01 -08:00
Alvin Moore 93c1810ad8
Merge pull request #2496 from apple/release-6.2
Merge Release 6.2 Into Master
2019-12-23 10:17:23 -08:00
Alvin Moore e14b3ed64e
Merge pull request #2494 from AlvinMooreSr/cmake_defines
CMake Release Fix
2019-12-23 07:38:24 -08:00
Alvin Moore 325d553973 Set the package release version based on if the build is a release package or not like the make builds 2019-12-23 02:42:02 -08:00
Alvin Moore 3ce3e1e06e Changed the name of the rpm packages to conform to the existing names when building release project 2019-12-22 20:11:40 -08:00
Meng Xu 8d6f511816 FastRestore:Resolve review comment
Filter out range mutations that do not overlap with the restore range.
Small changes on format.
2019-12-22 20:09:10 -08:00
Meng Xu 599571a055
Merge pull request #2491 from jzhou77/doc
Reformat data distributor design doc
2019-12-20 22:26:46 -08:00
Meng Xu 61b29de3ce FastRestore:Self code review
Clean up commented code;
Add sanity check.
2019-12-20 22:24:34 -08:00
Meng Xu ddcf3fdd80 FastRestore:Apply clang format 2019-12-20 22:00:36 -08:00
Meng Xu 2cd1f0780a FastRestore:Split asset to subasset for async parsing files 2019-12-20 21:44:40 -08:00
Meng Xu d888e3100b FastRestore:Applier:Add invariant 2019-12-20 19:34:28 -08:00
Meng Xu e98b2a0d1c FastRestore:Introduce RestoreAsset 2019-12-20 18:00:10 -08:00
Alvin Moore c0614bc037
Merge pull request #2492 from apple/release-6.2
Release 6.2 Merge Into Master
2019-12-20 15:21:33 -08:00
Alvin Moore 62ffcf343f
Merge pull request #2489 from AlvinMooreSr/cmake_defines
Cmake Package Name Fix
2019-12-20 14:34:11 -08:00
Jingyu Zhou 90d7db60a8 Change bullets back to paragraphs 2019-12-20 13:12:36 -08:00
Alvin Moore c7fc72af39 Changed the name of the java jar to conform with the existing prerelease nomenclature 2019-12-20 12:23:28 -08:00
Jingyu Zhou 861e23953c More formatting updates 2019-12-20 11:55:33 -08:00
Jingyu Zhou ac261f8f6a Reformat data distributor doc
Remove extra spaces and highlight code.
2019-12-20 11:51:11 -08:00
Meng Xu 35a38a3188
Merge pull request #2490 from ajbeamon/bindingtester-filter-future-version
Filter future_version errors in the binding tester
2019-12-20 11:42:56 -08:00
A.J. Beamon f97129e9ac Filter future_version errors in the binding tester 2019-12-20 11:22:23 -08:00
Alvin Moore 370786c95d Fixed package name (again) 2019-12-20 10:18:34 -08:00
Alvin Moore cb6ab87621 Fixed the name of the rpm and deb packages 2019-12-20 09:37:24 -08:00
Alvin Moore e226f41665 Added -PRERELEASE suffix to flow package 2019-12-20 09:36:48 -08:00
Jingyu Zhou 53d196070b
Merge pull request #2485 from xumengpanda/mengxu/change-StringRefReaderMX-PR-v2
Performant restore [12/XX add-on]: Rename StringRefReaderMX to BackupStringRefReader
2019-12-19 15:44:19 -08:00
Jingyu Zhou db953cc275
Merge pull request #2481 from alexmiller-apple/dq-pop-fixes
Fix an issue where a peek starting from version 1 could crash a TLog
2019-12-19 13:18:28 -08:00
Meng Xu ffc8f76710 FastRestore:Rename StringRefReaderMX to BackupStringRefReader 2019-12-19 11:49:37 -08:00
Evan Tschannen fca0e74655
Merge pull request #2418 from satherton/blobstore-api-enhancements
BlobStoreEndpoint enhancements
2019-12-19 11:23:37 -08:00
Alex Miller f58507c830 Rename poppedLocationForVersion -> versionForPoppedLocation 2019-12-19 10:24:31 -08:00
Alex Miller b5d82a74c3
Update fdbserver/TLogServer.actor.cpp
Co-Authored-By: Jingyu Zhou <jingyuzhou@gmail.com>
2019-12-19 10:20:52 -08:00
A.J. Beamon 414be7a0e4
Merge pull request #2479 from AlvinMooreSr/release_6.2_merge
Release 6.2 merge
2019-12-19 09:36:05 -08:00
A.J. Beamon 45700c535a
Merge pull request #2472 from vishesh/doc-compare-and-clear-6.2
DocBlitz: atomic compare and clear
2019-12-19 09:04:48 -08:00
A.J. Beamon d12dd1b6a2
Merge pull request #2476 from tclinken/add-status-doc-comments-to-6.2
Add status documentation comments to 6.2
2019-12-19 08:47:51 -08:00
Meng Xu 47c4c69691
Merge pull request #2473 from jzhou77/doc
Documentation: Add explanation of recovery version and copy data during recovery
2019-12-18 15:15:41 -08:00
Jingyu Zhou 7adf444468 Apply review comment 2019-12-18 15:05:07 -08:00
Xin Dong ce80aacdbb
Merge pull request #2482 from xumengpanda/mengxu/fastrestore-test-load-PR
Performant restore [12/XX add-on]: Increase the test workload to normal
2019-12-18 15:03:16 -08:00
Jingyu Zhou e6b942dccc Reorganize structure a bit 2019-12-18 15:00:43 -08:00
Meng Xu 0a30bfcc9e Merge branch 'master' into mengxu/fastrestore-test-load-PR 2019-12-18 13:47:07 -08:00
Vishesh Yadav 902029bbec
Merge pull request #2448 from mpilman/issues/2446
Changed failure monitor ping delay to 1 second
2019-12-18 13:26:34 -08:00
Alex Miller b98107ccab
Update fdbserver/OldTLogServer_6_2.actor.cpp 2019-12-18 11:15:18 -08:00
Jingyu Zhou 0552e9aa12
Merge pull request #2452 from ajbeamon/document-network-thread-and-client-logging
Add some documentation for the client network thread and client logging.
2019-12-18 10:41:39 -08:00
Alex Miller 65ebe23b55
Merge pull request #2423 from schedutron/patch-1
Improve readability for Makefile Linux step
2019-12-18 10:26:19 -08:00
Alvin Moore 21390c493a Merge branch 'release-6.2' of github.com:apple/foundationdb into release_6.2_merge
Resolved merge by keeping new test file from master branch: SampleNoSimAttrition.txt adding new constraint from Release branch about existing test file: SimpleExternalTest.txt

# Conflicts:
#	tests/CMakeLists.txt
2019-12-18 09:05:08 -08:00
Alex Miller d8cbd495af Fix another pop + spill/dq-pop interleaving issue
This fixes an issue introduced in the previous patch, where pop would
immediately set `poppedLocationNeedsUpdate`, but setting the popped
version was now delayed.  This means that we could:

1. Run the spill loop and persist all popped versions
2. Receive a pop, and set the poppedLocationNeedsUpdate flag
3. Run the dq-pop loop, and clear the poppedLocationNeedsUpdate flag

and now when we update the persistentPopped version again, we won't have
the flag set for dq-pop to know that it needs to scan the spilled data
again for the minLocation.

We could more carefully update the flag, but instead, I've just
converted it into a version that's kept in sync purely in the dq-pop
loop, to remove shared state between pop and the dq-pop loop.
2019-12-17 23:15:48 -08:00