Commit Graph

244 Commits

Author SHA1 Message Date
Jingyu Zhou ae7e42face
Merge pull request #2313 from xumengpanda/mengxu/fastrestore-applyToDB-bugfix-PR
Performant restore [8/XX]: Fix bugs in applyToDB logic and add more tests
2019-11-12 08:50:23 -08:00
Jingyu Zhou 120444ab4e
Merge pull request #2334 from mpilman/features/package-tests
Add cmake command to package tests
2019-11-08 19:52:57 -08:00
Markus Pilman d0d036b3a7 Add cmake command to package tests 2019-11-08 21:39:21 +00:00
Steve Atherton fe79742881
Merge pull request #2333 from apple/release-6.2
Merge release 6.2 to master
2019-11-08 11:01:07 -08:00
Stephen Atherton b50d26c4da KVStoreTest now runs sqlite and redwood tests. 2019-11-05 13:46:04 -08:00
Meng Xu 27c7ef09a3 FastRestore:Revise code in self review
When we read the txnId from decodeRestoreApplierKey func,
we should convert the integer to little endian.
2019-11-03 20:43:17 -08:00
Meng Xu 7cf87e9ae3 FastRestore:Add ParallelRestoreCorrectnessCycle.txt test 2019-11-03 17:31:54 -08:00
Meng Xu 63359bfc8b FastRestore:handleInitVersionBatchRequest:Ensure exact once execution
Also increase the test workload for BackupAndParallelRestoreWithAtomicOp test
2019-11-03 17:26:13 -08:00
Evan Tschannen ef14f7a718
Merge pull request #2292 from etschannen/master
Merge 6.2 into master
2019-10-25 09:18:20 -07:00
Jingyu Zhou a30e6ec147
Merge pull request #2277 from xumengpanda/mengxu/fastrestore-atomicOpTest-increaseLoadAndBugFix-PR
Performant restore [7/XX]: Add tests for transactionBatchSizeThreshold when apply mutations
2019-10-24 21:21:14 -07:00
Evan Tschannen 3325980c03 Merge branch 'release-6.2'
# Conflicts:
#	CMakeLists.txt
#	documentation/sphinx/source/release-notes.rst
#	fdbserver/DataDistribution.actor.cpp
#	fdbserver/OldTLogServer_6_0.actor.cpp
#	fdbserver/TLogServer.actor.cpp
#	fdbserver/WorkerInterface.actor.h
#	fdbserver/worker.actor.cpp
#	versions.target
2019-10-24 17:38:15 -07:00
Jon Fu 2f34ee684f fixed indentation issues 2019-10-24 13:21:28 -07:00
Jon Fu b74e5b1543 added sample file for attrition test outside of simulation 2019-10-24 13:10:59 -07:00
Meng Xu 7af3239ee7 FastRestore:AtomicOpTest:Debug:1 key per group for ops keyspace 2019-10-23 14:36:34 -07:00
Meng Xu ba7e499efe FastRestore:AtomicOpTest:Limit 1 actor per client 2019-10-23 14:04:14 -07:00
Meng Xu e676348710
Merge pull request #1955 from fzhjon/mark-ss-failed
Add fdbcli and API command to mark storage servers as permanently failed
2019-10-22 23:36:30 -07:00
Meng Xu 96d463bab6 FastRestore:Fix bug in applying mutations and increase atomicOp test worload
When Applier applies mutations to the destination cluster, it advances the
mutation cursor twice when it should only advance it once.
This makes restore miss some mutations when the applying txn includes
more than 1 mutations.
2019-10-22 23:24:23 -07:00
Meng Xu 01b4fb5e5e CMake:Add performant restore test to CMake 2019-10-21 14:52:03 -07:00
Meng Xu 970327b554 FastRestore:Add ParallelRestoreCorrectnessAtomicOpTinyData.txt 2019-10-21 14:42:11 -07:00
Jon Fu 450a09e117 Code Review Changes 2019-09-24 15:48:50 -07:00
Jon Fu 471e283128 Merge branch 'master' of https://github.com/apple/foundationdb into mark-ss-failed 2019-09-18 11:49:07 -07:00
Evan Tschannen 680f0e3bd8 updated CMakeLists 2019-09-13 09:30:40 -07:00
Evan Tschannen 05eac989da unpair the cycle test with configure test for now, because tests were timing out 2019-09-13 09:20:06 -07:00
Evan Tschannen 5bf8d61d81 pair configureDatabase tests with cycle tests to ensure that changing the configuration does not corrupt data 2019-09-04 18:41:22 -07:00
Jon Fu 807b02551e updated help message and changed existing workload to use mark as failed feature 2019-08-27 14:39:43 -07:00
Stephen Atherton 10be4b8127 Merge branch 'master' of github.com:apple/foundationdb into feature-redwood
# Conflicts:
#	fdbserver/VersionedBTree.actor.cpp
2019-08-07 04:20:14 -07:00
Stephen Atherton da9c4e97d3 Added new pager interface, IPager2, whose write interface enables forcing the user to handle a page update causing a copy to a new Page ID. Implemented FIFOQueue<T> which uses pages of T stored in a Pager2 instance to implement a FIFO queue. Implemented COWPager, a copy-on-write Pager2 in which all page writes cause a change of Page ID. VersionedBTree, still only operating in single-version mode, now uses Pager2. 2019-08-07 02:36:33 -07:00
mpilman f453c12f0f remove object serialization flag from TestRunner 2019-08-06 10:20:01 -07:00
A.J. Beamon 438bc636d5 Rename max_machine_failures_without_losing_X to max_zone_failures_without_losing_X in status. 2019-07-30 14:02:31 -07:00
Evan Tschannen 8149b5b352
Merge pull request #1413 from atn34/change-connection-file
Switch cluster file feature
2019-07-26 13:27:37 -07:00
sramamoorthy 9afd162e2f remove snap v1 related code 2019-07-25 17:29:31 -07:00
sramamoorthy a2f2ad96ff code review comments and merge to master changes 2019-07-24 15:36:28 -07:00
sramamoorthy c18558cf55 enable DD mode in restore based on test spec 2019-07-24 15:36:28 -07:00
sramamoorthy 24cbe313a1 Snap*Restart in ver 2 and buggify off in restore 2019-07-24 15:36:28 -07:00
Trevor Clinkenbeard 9ad9bd4c1f Merge branch 'master' of https://github.com/apple/foundationdb into change-connection-file 2019-07-24 15:22:26 -07:00
Vishesh Yadav 2f9f3c184f
Merge pull request #1870 from alexmiller-apple/txnStateStore-workload
Add ability to bulk load data into TxnStateStore
2019-07-22 13:20:39 -07:00
Alex Miller 4ac1a0f557 Add ability to bulk load data into TxnStateStore
* Changes BulkLoad workload to support a specific volume of data to load
* Changes BulkLoad and Cycle to correctly handle \xff in keyPrefix
* Adds BulkLoad to TxnStateStoreCycleTest
2019-07-19 18:01:24 -07:00
Evan Tschannen 3045826e3c
Merge pull request #1819 from mpilman/flatbuffers-fixes2
Flatbuffers fixes2
2019-07-19 16:33:50 -07:00
Alex Miller c3a8ae4752
Merge pull request #1791 from fzhjon/fetch-keys-requests-priority
Introduce priority to fetchKeys requests from data distribution
2019-07-19 14:54:51 -07:00
mpilman 1ac2d01b03 Merge remote-tracking branch 'upstream/master' into flatbuffers-fixes2 2019-07-18 09:50:08 -07:00
mpilman d5caf0c1b4 Merge branch 'flatbuffers-fixes2' of github.com:mpilman/foundationdb into flatbuffers-fixes2 2019-07-16 14:47:40 -07:00
dyoungworth f3d3f80ed2 Merge branch 'master' into bugFix 2019-07-15 14:49:19 -07:00
Jon Fu 4b0fdabae5 mark test file as IGNORE and comment out dead placeholder code 2019-07-15 09:45:16 -07:00
Evan Tschannen 1a18c859c7 knobified the durability lag rate controls 2019-07-12 18:50:56 -07:00
Andrew Noyes 969957e619 Merge branch 'master' into change-connection-file 2019-07-12 11:39:19 -07:00
Andrew Noyes 1cf036fc9f Remove SnapTestAttrition from ctest
SnapTestAttrition the test file was removed in a53bf928
2019-07-12 10:43:42 -07:00
Andrew Noyes bc29b1e78a Use flatbuffers for testing 2019-07-11 23:03:31 -07:00
Andrew Noyes 274cb40eb8 Run tests under valgrind when USE_VALGRIND 2019-07-11 23:03:31 -07:00
dyoungworth 35be45d4ce Remove code accidentally left for testing ctest fix 2019-07-11 10:01:26 -07:00
Jon Fu 695ca5e8e9 moved location of DDMetricsExclude test txt file 2019-07-11 09:56:59 -07:00