Commit Graph

886 Commits

Author SHA1 Message Date
negoyal 078cc7ee55 Merge branch 'master' into bit-flipping-workload 2021-09-10 10:26:21 -07:00
Josh Slocum c2d1d1704f Merge branch 'feature-range-feed' into blob_full 2021-09-10 11:21:52 -05:00
Evan Tschannen ac5b580e2d Merge branch 'master' into feature-range-feed
# Conflicts:
#	fdbcli/fdbcli.actor.cpp
#	fdbclient/StorageServerInterface.cpp
#	fdbclient/StorageServerInterface.h
#	fdbserver/ApplyMetadataMutation.cpp
#	fdbserver/TLogServer.actor.cpp
#	flow/error_definitions.h
2021-09-09 23:13:22 -07:00
negoyal a48148fdb2 Tweak the chaos toml file. 2021-09-08 22:53:52 -07:00
negoyal 7729a282ce Misc fixes and updated test toml file. 2021-09-08 14:31:09 -07:00
Josh Slocum eb76343dfb Added blob granule reassignment and splitting 2021-09-08 14:09:14 -05:00
Evan Tschannen 9fefd59076 Fixed a number of bugs, change feeds are correctness clean with the current workload 2021-09-05 18:17:23 -07:00
Evan Tschannen 367c7cda92 fixed problems with the change feed workload 2021-09-03 15:14:28 -07:00
negoyal a8baeb75d0 Misc fixes. 2021-09-03 15:03:12 -07:00
Evan Tschannen b02e8d99c6 added a workload to test change feeds 2021-09-03 14:19:27 -07:00
Chaoguang Lin 82e1e850c2 Add syntax until_*.*.* in restarting test to specify upper bound of binary version 2021-09-02 14:07:15 -07:00
A.J. Beamon ee357881b5 Add the new test to cmake 2021-08-31 15:19:52 -07:00
A.J. Beamon f78a68735a Add a specific unit test file for use by tooling. 2021-08-31 15:06:13 -07:00
negoyal 3b34423248 Merge branch 'master' into bit-flipping-workload 2021-08-31 12:14:51 -07:00
Jon Fu 25b8e2e152 Exclude redwood in from_5.0.0 tests 2021-08-30 17:13:49 -04:00
Jon Fu 3f77c72821 Exclude redwood from part 1 of restarting tests that are from versions < 6.3 2021-08-30 16:49:49 -04:00
sfc-gh-tclinkenbeard 8f97d66b44 Increase minimum downgrade version 2021-08-30 11:14:59 -07:00
sfc-gh-tclinkenbeard 6ecc38d22a Strengthen ConfigIncrement.toml test 2021-08-27 15:18:32 -07:00
Josh Slocum 8d49c98a41 Added simulation workload for blob granules and fixed some bugs 2021-08-26 13:48:05 -05:00
sfc-gh-tclinkenbeard 288933bdf6 Add MachineAttrition to ConfigIncrement workload 2021-08-24 11:30:41 -07:00
sfc-gh-tclinkenbeard a047782db2 Merge remote-tracking branch 'origin/master' into paxos-config-db 2021-08-24 11:08:20 -07:00
sfc-gh-tclinkenbeard 9e7ed1f18c Randomize configuration database type for ConfigIncrement test 2021-08-24 11:08:06 -07:00
Steve Atherton ebdb9064ff
Merge pull request #5359 from RenxuanW/mlr
Check in the prototype of MutationLogReader.
2021-08-19 21:11:10 -07:00
sfc-gh-tclinkenbeard 658233d0e0 Merge remote-tracking branch 'origin/master' into paxos-config-db 2021-08-19 16:18:59 -07:00
Renxuan Wang 454beeb1cf Delete toml for unit test. 2021-08-18 15:01:45 -07:00
Renxuan Wang 6e89dc3da0 Check in the prototype of MutationLogReader. 2021-08-18 14:59:50 -07:00
Mohamed Oulmahdi bce42671ff Add IThreadPool test to cmake 2021-08-18 16:05:12 +02:00
sfc-gh-tclinkenbeard 0bacc310ef Reenable consumer in config broadcaster 2021-08-17 12:09:12 -07:00
sfc-gh-tclinkenbeard 47b4c9a4f7 Temporarily disable ConfigIncrement test 2021-08-16 10:50:14 -07:00
sfc-gh-tclinkenbeard 3418c20867 Merge remote-tracking branch 'origin/master' into paxos-config-db 2021-08-16 10:49:47 -07:00
sfc-gh-tclinkenbeard d8bdc972ba Only test simple configuration database in ConfigIncrement.toml
There are still some issues with the Paxos implementation that are
causing test failures at the moment.
2021-08-10 11:18:56 -07:00
Josh Slocum 921a2cfca1 Merge branch 'feature-range-feed' into blob_full 2021-08-10 11:25:48 -05:00
Josh Slocum 247602753d Blob worker handles multiple ranges now 2021-08-10 11:19:43 -05:00
helium 751fc59d54 revert unintended changes 2021-08-09 16:29:57 -07:00
helium 15d050ece5 Added unit test, and bug fixes. 2021-08-09 16:26:29 -07:00
helium 9a9346afaf Added unit test. 2021-08-09 16:21:43 -07:00
sfc-gh-tclinkenbeard c126e6239b Weaken ConfigIncrement.toml test
This test is not yet stable, so simplify the test in order to make
debugging easier.
2021-08-09 10:18:18 -07:00
sfc-gh-tclinkenbeard f6b6e11d6a Support randomizing configuration database type in simulation 2021-08-09 10:04:35 -07:00
sfc-gh-tclinkenbeard cdbcb69d86 Add configuration database type to ISimulator 2021-08-09 10:04:35 -07:00
sfc-gh-tclinkenbeard 6524dd1567 Add random sleep to ConfigIncrement workload 2021-08-09 10:04:35 -07:00
sfc-gh-tclinkenbeard 7deb339a0c Added ConfigIncrement.toml test 2021-08-09 10:04:35 -07:00
Josh Slocum e5b0cf20aa Reader can read blob worker interface and mapping from db, read files, apply mutations, and return result 2021-08-06 11:02:05 -05:00
negoyal 9e7197faba Bunch of changes based on review comments and discussions. 2021-07-30 01:32:43 -07:00
negoyal 40b4f3b2f1 Merge branch 'master' into bit-flipping-workload 2021-07-28 18:06:07 -07:00
negoyal 050c218502 New Disk Delay Logic and ChaosMetrics. 2021-07-28 16:03:37 -07:00
Markus Pilman 91e5498357 disable simulation in ctest by default 2021-07-27 11:17:55 -06:00
Trevor Clinkenbeard 48d4ea6d57
Merge pull request #5231 from sfc-gh-tclinkenbeard/availability-improvements
Throw `failed_to_progress` error when a role fails to make progress
2021-07-26 15:55:14 -07:00
sfc-gh-tclinkenbeard 1dc9839e49 Increase max latency for LowLatencySingleClog test 2021-07-19 22:34:27 -07:00
negoyal 596ca92e2f Add missing files and rename some. 2021-07-19 11:13:57 -07:00
negoyal f950fe9f9d Chaos workload to randomly flip bits during SS writes. 2021-07-18 17:35:05 -07:00
Steve Atherton 09a8561606 Merge branch 'master' of github.com:apple/foundationdb into redwood-io-priority
# Conflicts:
#	fdbserver/IPager.h
#	fdbserver/VersionedBTree.actor.cpp
2021-07-18 01:49:36 -07:00
Evan Tschannen b7b845dab8
Revert "RocksDB in simulation" 2021-07-15 16:41:33 -07:00
Chaoguang Lin c8e18f99f0
Merge pull request #5185 from sfc-gh-clin/extend-fdbclient-test-for-multiple-processes
Extend cmake fdbclient_test for multiple processes
2021-07-15 14:34:04 -07:00
Daniel Smith 4c1288faa7
Merge pull request #5144 from Daniel-B-Smith/rocksdb-in-simulation
RocksDB in simulation
2021-07-15 16:00:09 -04:00
Chaoguang Lin 3552080266 Update some comments of the change 2021-07-15 16:38:04 +00:00
Chaoguang Lin a3ae0c26ca Add comments, fix foundationdb.conf template 2021-07-14 22:36:17 +00:00
Chaoguang Lin 063de7d7fc Remove unnecessay change, fix bug 2021-07-14 21:26:54 +00:00
Chaoguang Lin c6a01d3976 Set process_number=1 for TempCluster 2021-07-14 21:21:52 +00:00
Chaoguang Lin b5629bc014 Add default value for process_number in the constructor of TempCluster 2021-07-14 20:58:20 +00:00
Chaoguang Lin 41a9470058 Add comments, remove debugging info 2021-07-14 20:24:16 +00:00
Chaoguang Lin 1e3d3811cc Merge branch 'master' of github.com:apple/foundationdb into extend-fdbclient-test-for-multiple-processes 2021-07-14 20:20:39 +00:00
Chaoguang Lin 368657623a Extend add_fdbclient_test to support multiple processes' cluster 2021-07-14 20:17:12 +00:00
sfc-gh-tclinkenbeard 475abe301c Merge remote-tracking branch 'origin/master' into fix-ub 2021-07-14 10:47:02 -07:00
Daniel Smith 6e0bfba745 Don't use the RocksDB engine with snapshot tests 2021-07-13 12:25:11 -04:00
Russell Sears c42815f15f
Merge pull request #5127 from vishesh/cherrypick
Making it possible to run a multiple-cluster Java integration test (cherry-pick of #4456 from 6.3)
2021-07-13 09:14:20 -07:00
negoyal 1b8b22decc Wrapper class to avoid adding overhead to all async disk calls 2021-07-12 17:51:01 -07:00
sfc-gh-tclinkenbeard 4ce6b8eea1 Disable LowLatencySingleClog test 2021-07-12 17:18:29 -07:00
sfc-gh-tclinkenbeard fbc4f47882 Add LowLatencySingleClog.toml test 2021-07-10 17:30:20 -07:00
Scott Fines d1db0d4013 Making it possible to run a multiple-cluster Java integration test 2021-07-07 10:15:18 -07:00
negoyal 957eceb14c And the test file. 2021-07-01 15:01:13 -07:00
negoyal df39c5a44e Implement Disk Throttling Chaos workload. 2021-06-30 17:05:04 -07:00
Zhe Wu 865367fb72 Add updateWorkerHealth interface in cluster controller 2021-06-24 19:42:28 -07:00
Andrew Noyes c9b06839fc Halt on error in ubsan for ctest tests 2021-06-23 09:25:51 -07:00
Trevor Clinkenbeard 481b785953
Merge pull request #5020 from dlambrig/issue4984
Do not allow descriptor to change on upgrade tests
2021-06-21 09:13:38 -07:00
Dan Lambright 68b58b71db Do not allow descriptor to change on upgrade tests 2021-06-21 11:54:44 -04:00
Zhe Wu e3c9d9f6a0
Merge pull request #4987 from halfprice/zhewu/worker-health-monitor
Create health monitor in FDB workers to monitor peer network condition
2021-06-17 16:58:24 -07:00
Daniel Smith f9edb3d870
Merge pull request #4983 from Daniel-B-Smith/rollforward-test-nonsim
Roll forward: Add support for running non-simulation tests on Joshua
2021-06-16 18:49:00 -04:00
Zhe Wu 4e3e2b0392 Create health monitor in FDB workers to monitor network condition. This change is only inside the worker. 2021-06-16 14:50:44 -07:00
Xiaoxi Wang 8f3e8ecf10 add injected fault check 2021-06-15 21:47:16 +00:00
Daniel Smith 44cba555eb Don't fail on missing simfdb dir 2021-06-15 14:15:02 -04:00
Daniel Smith 6eb383cfc3 Run noSim test as a unit test 2021-06-15 14:15:02 -04:00
Daniel Smith efdda3cd0e Revert "Revert "Add support for running non-simulation tests on Joshua"" 2021-06-15 14:15:02 -04:00
Daniel Smith 549cf0512b
Revert "Add support for running non-simulation tests on Joshua" 2021-06-14 19:23:56 -04:00
Daniel Smith ef2a2cd1a5 Actually add test file 2021-06-14 15:00:45 -04:00
Daniel Smith 8af0affeff Add support for running non-simulation tests on Joshua 2021-06-14 15:00:45 -04:00
Josh Slocum ad90b03012
Merge pull request #4949 from sfc-gh-jslocum/tss_downgrade
TSS downgrade changes
2021-06-10 14:06:38 -07:00
Josh Slocum 59726545a4 TSS downgrade changes 2021-06-10 19:30:45 +00:00
Andrew Noyes eebba211ef 150 was too short and we were seeing false positives 2021-06-10 11:14:38 -07:00
A.J. Beamon 6f5ae9d76a
Merge pull request #4882 from sfc-gh-ajbeamon/restarting-test-increase-6.2-version
Require a minimum of 6.2.33 for 6.2 snapshot restarting tests
2021-06-01 09:42:07 -07:00
A.J. Beamon f28dae7c70 Require a minimum of 6.2.33 for 6.2 snapshot restarting tests to avoid a bug in prior versions 2021-05-28 12:43:30 -07:00
Josh Slocum ce82c9653e Testing Storage Server implementation 2021-05-25 20:28:50 +00:00
Markus Pilman 64608fe86b allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
Lukas Joswiak 6499fa178e
Merge pull request #4802 from sfc-gh-ljoswiak/revert/actor-lineage
Revert "Merge pull request #4136 from sfc-gh-mpilman/features/actor-l…
2021-05-11 18:50:42 -07:00
Chaoguang Lin ed3415c93e Guard the added unit test by NOT OPEN_FOR_IDE 2021-05-11 12:21:09 -07:00
Chaoguang Lin 804354f9b2 Merge branch 'master' of github.com:apple/foundationdb into refactor-fdbcli 2021-05-11 12:14:59 -07:00
Lukas Joswiak 4ea760b2a9 Revert "Merge pull request #4136 from sfc-gh-mpilman/features/actor-lineage"
This reverts commit da41534618, reversing
changes made to e6300905d6.
2021-05-10 20:26:12 -07:00
Edwin Zhang 3d9619790d Fix OPEN_FOR_IDE option for cmake 2021-05-07 17:54:59 -04:00
Chaoguang Lin 24247057ff Add two safeThreadFuture unit tests into ctest 2021-05-06 16:34:13 -07:00
Lukas Joswiak 8dcd779fc4
Merge branch 'master' into features/actor-lineage 2021-05-02 14:11:42 -07:00
A.J. Beamon 8eb78fd317
Merge pull request #4714 from sfc-gh-anoyes/anoyes/more-thread-safety-ctest
Add /fdbclient/multiversionclient/ to ctest, and fix thread safety
2021-04-28 08:54:16 -07:00
Markus Pilman 4fab2ecd30 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-28 09:20:54 -06:00
Andrew Noyes 6fc59379d8 Add /fdbclient/multiversionclient/ to ctest, and fix thread safety 2021-04-23 21:17:41 +00:00
Josh Slocum 4b5bca6761 Minor Redwood comparison optimizations 2021-04-23 18:49:43 +00:00
Russell Sears 77af97c7a3
Merge pull request #4622 from vishesh/task/fix-loopback-cluster
loopback_cluster: Find `fdbcli` from `$BUILD` path
2021-04-22 10:05:00 -07:00
Steve Atherton 9ee2cd7bcb Renamed prefixesAllowed again for clarity. 2021-04-20 11:54:40 -07:00
Steve Atherton 3c7dc1a59e Backup correctness workload bug fix. Sometimes the restore target ranges are empty, which causes a test timeout. Renamed some variables for clarity. 2021-04-19 21:36:47 -07:00
Markus Pilman 7307750e5e Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-19 11:29:52 -06:00
Markus Pilman a445e09c2d
Merge pull request #4617 from sfc-gh-satherton/unit-test-params
Added UnitTest parameters concept and ability to run unit tests directly from command line, with parameters
2021-04-15 14:59:15 -06:00
Steve Atherton 8616575c21 Merge commit 'd51f94f16ee903aa249ddaac0047c88cafac1e89' into unit-test-params 2021-04-14 18:23:00 -07:00
Jon Fu f6f225ccae Merge branch 'master' of github.com:apple/foundationdb into jfu-test-conf-options 2021-04-14 14:21:23 -04:00
Steve Atherton 6bcd997bb9 Merge commit '83cc3d3af058fdcb23a8681e0bf28cac7de3e61e' into unit-test-params 2021-04-14 10:04:55 -07:00
Markus Pilman 1d362d8869 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-14 09:55:04 -06:00
Steve Atherton 1c5013f6ec Removed btree cleanup parameter override. 2021-04-13 20:19:25 -07:00
Andrew Noyes eb4c80db39 Respect the version constraints for restart tests in ctest 2021-04-12 23:15:17 +00:00
Jon Fu 57d24263ef Merge branch 'master' of github.com:apple/foundationdb into jfu-test-conf-options 2021-04-12 13:23:18 -04:00
Aaron Molitor 2de2ebd337 add old fdb binaries to build image, update cmake to look in the right place, add new alias to devel image, update FDBTLS lib install for joshua, get the default joshua branch 2021-04-08 12:05:59 -05:00
Steve Atherton 7b08886caf Updated btree unit test name. 2021-04-07 18:29:17 -07:00
Jon Fu 2a64c227fb Added options to test config that specify maxtlogversion and array of excluded storage engine types 2021-04-07 15:59:51 -04:00
Vishesh Yadav cf33cea0b4 loopback_cluster: Find `fdbcli` from `$BUILD` path
Currently expects to find `fdbcli` in current path, which doesn't seem
right. `fdbcli` should always be in the directory where we'll find
`fdbserver`.
2021-04-06 13:44:33 +00:00
Steve Atherton e7573d546f Some unit tests names had a prefixed "!" in order to be excluded from random selection, this has been changed to a ":" as it is less problematic on the command line. Some Redwood unit tests have been enabled for random selection. 2021-04-05 00:03:15 -07:00
Markus Pilman dc35af3760 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-01 11:01:31 -06:00
Jon Fu 69d88dcf96 adjust placement of option in test workload 2021-03-25 15:25:50 -04:00
Jon Fu 1541f4234a Updated test parser with new option and also added option to test file with default value 2021-03-25 14:40:06 -04:00
Markus Pilman eb036b7b02 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-03-17 11:59:54 -06:00
A.J. Beamon 25c4880ebe Merge branch 'release-6.3' into merge-release-6.3-into-master (temporarily discard all changes to BackupContainer.actor.cpp)
# Conflicts:
#	fdbclient/BackupContainer.actor.cpp
#	fdbserver/Knobs.h
2021-03-15 16:41:04 -07:00
A.J. Beamon b7614bad24 Update the multithreaded_client test to work with Python 3 2021-03-10 16:47:33 -08:00
Andrew Noyes 18ee11e69a Use add_fdbclient_test for java integration tests
Also change add_fdbclient_test to run its subcommand with FDB_CLUSTER_FILE set
2021-03-02 01:54:17 +00:00
negoyal e9b7e22e02 Merge branch 'rel-6.3' 2021-02-22 08:47:22 -08:00
Russell Sears 555f3ebfaa Implement + test corner case configurations for mutlithreaded client. 2021-02-12 22:37:24 +00:00
Russell Sears 4938aee113 Address PR comments, remove some old cruft + comments 2021-02-11 01:27:57 +00:00
Russell Sears cd2fe438ff Harness to spawn multiple FDB clusters, and Vishesh's python multithreaded client test 2021-02-11 01:10:29 +00:00
Nim Wijetunga 3b48942f9a resolve pr comments 2021-02-09 17:56:30 -05:00
Nim Wijetunga 2560dc0227 add test workload 2021-02-09 12:32:37 -05:00
Steve Atherton d718e7baf3
Merge pull request #4179 from sfc-gh-tclinkenbeard/run-minio-joshua
Support Testing S3BlobStore backup in simulation
2021-01-26 14:39:57 -08:00
Andrew Noyes 6a40b007e6 Resolve conflicts 2021-01-25 18:57:12 +00:00
Andrew Noyes adde95bea5 Merge branch 'release-6.3' into anoyes/merge-6.3-to-master
Commit merge conflicts for now
2021-01-25 18:55:24 +00:00
sfc-gh-tclinkenbeard 51cbc494f1 Merge remote-tracking branch 'origin/master' into run-minio-joshua 2021-01-23 11:31:19 -08:00
Andrew Noyes 58b4a9b907 Resolve conflicts 2021-01-21 20:59:44 +00:00
Andrew Noyes 281151ff20 Merge remote-tracking branch 'upstream/release-6.2' into anoyes/merge-6.2-to-6.3
Commit conflict markers for now
2021-01-21 17:54:26 +00:00
Andrew Noyes ff7d306b09 Merge branch 'release-6.3' into anoyes/merge-6.3-to-master
Include conflict markers for now. Will resolve.
2021-01-15 18:04:09 +00:00
Andrew Noyes ddb5b0b050 Backport correctness package 2021-01-15 00:34:47 +00:00
Markus Pilman 8e93573aad Merge branch 'master' of github.com:apple/foundationdb into features/actor-lineage 2021-01-05 10:24:45 -07:00
sfc-gh-tclinkenbeard 61a29ecfc8 Merge remote-tracking branch 'origin/master' into run-minio-joshua 2021-01-01 09:38:36 -04:00
sfc-gh-tclinkenbeard 2a8f971733 Fix Azure blob storage backup test 2020-12-24 21:20:05 -04:00
sfc-gh-tclinkenbeard 1dc0343092 Update blob backup test files 2020-12-24 21:20:05 -04:00
Andrew Noyes 9601769b01
Merge pull request #3858 from sfc-gh-rchen/stable_interfaces
Stable interfaces
2020-12-11 09:34:27 -08:00
Markus Pilman f8e1df6c4f Support for actor stack traces 2020-12-10 10:42:04 -07:00
sfc-gh-tclinkenbeard aa351d37d3 Increase stable snapshot lower bound to 6.2.29 2020-12-09 10:44:26 -08:00
Andrew Noyes 7fbc4d7391 Resolve conflicts 2020-12-04 23:58:42 +00:00
Andrew Noyes 877997632d Merge branch 'release-6.3' into anoyes/merge-release-6.3-master
Include conflict markers for review purposes
2020-12-04 01:38:07 +00:00
Richard Chen c77d9e4abe merge conflicts 2020-12-02 21:53:19 +00:00
sfc-gh-tclinkenbeard 882b77eae0 Change earliest downgrade version to 6.3.10
Because FDB7 will write xxhash3 checksums for sqlite pages, and these
are not read by 6.3 until patch 6.3.10, the downgrade tests should only
attempt to versions >=6.3.10
2020-11-24 00:28:53 -08:00
sfc-gh-tclinkenbeard 16f68babd3 Ignore downgrade testing for now
Since we're writing xxhash3 checksums that 6.3 can't yet understand,
these tests would fail currently.
2020-11-21 20:18:33 -08:00
sfc-gh-tclinkenbeard 45c9a0abc7 Revert "Revert "Add limiting health metrics""
This reverts commit 209ebcc595.
2020-11-13 17:24:57 -08:00
Trevor Clinkenbeard 209ebcc595
Revert "Add limiting health metrics" 2020-11-13 17:08:46 -08:00
Trevor Clinkenbeard 8c0b4dbe4c
Merge pull request #4067 from sfc-gh-tclinkenbeard/add-limiting-health-metrics
Add limiting health metrics
2020-11-13 16:04:44 -08:00
sfc-gh-tclinkenbeard 9bb93dadf1 Reenabled Throttling.toml test (as a rare test) 2020-11-13 11:34:32 -08:00
sfc-gh-tclinkenbeard ac89b60c7d Remove reference to non-existant WriteTagThrottling.txt 2020-11-12 20:15:10 -08:00
Markus Pilman 0f205620bf
Merge branch 'master' into features/udp 2020-11-12 13:51:17 -07:00
Jon Fu 1eff31b0e5 don't run consistency check until after the backup is discontinued 2020-11-09 13:22:41 -05:00
sfc-gh-tclinkenbeard d134c2cb14 Make sure only uppercase characters follow underscore in test titles
These test titles are used in trace lines, so having an underscore
followed by a lower-case character leads to invalid trace lines
2020-11-08 14:30:55 -08:00
Jon Fu ac0e4c1705 unpause backup as soon as possible when waiting for version 2020-11-04 15:13:02 -05:00
Jon Fu bda72d9a3d first draft at changing snapshot backup behaviour 2020-11-02 17:12:30 -05:00
Richard Chen 9c6c2704d0 Merge branch 'master' of https://github.com/apple/foundationdb into stable_interfaces 2020-10-30 23:59:32 +00:00
sfc-gh-tclinkenbeard 55e86c1336 Disambiguate between S3BlobStore and other blob stores 2020-10-29 20:42:23 -07:00
Steve Atherton 96cc700440
Merge pull request #3961 from sfc-gh-tclinkenbeard/azure-backup
Add support for writing backup files directly to Azure blob storage
2020-10-29 00:30:40 -07:00
sfc-gh-tclinkenbeard 95e5130903 Don't rewrite BeforeRestart prefix in UpgradeAndBackupRestore-2 2020-10-28 14:06:40 -07:00
sfc-gh-tclinkenbeard e389a5dabe Fix issues with Azure credentials 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard c6739f7075 Add skeleton for BackupContainerAzureBlobStore::listURLs 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard f3c52ed41e Guard Azure backup compilation behind CMake variable 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard e9de39f525 Add machine attrition to BackupBlobCorrectness test 2020-10-24 16:48:00 -07:00
sfc-gh-tclinkenbeard 273ea97879 Renamed BackupToBlob.toml BackupBlobCorrectness.toml 2020-10-24 16:47:59 -07:00
sfc-gh-tclinkenbeard 82b6daa16b First draft of Azure blob storage backup container 2020-10-24 16:47:51 -07:00
Richard Chen 055add9682 conflicts 2020-10-23 06:33:00 +00:00
sfc-gh-tclinkenbeard 6877e0ee4f Merge remote-tracking branch 'origin/master' into fix-upgrade-and-backup-test 2020-10-22 14:07:34 -07:00
sfc-gh-tclinkenbeard 09d5ed9cb4 Fix typo in UpgradeAndBackupRestore-2.toml 2020-10-22 13:09:41 -07:00
sfc-gh-tclinkenbeard d47642f37d Disable consistency check for first test of UpgradeAndBackupRestore 2020-10-22 12:57:05 -07:00
sfc-gh-tclinkenbeard 9d8f831214 Use toml for UpgradeAndBackupRestore test files 2020-10-21 20:36:12 -07:00
sfc-gh-tclinkenbeard 313d4aae58 Disable consistency check in UpgradeAndBackupRestore test until backup is stopped 2020-10-21 20:23:20 -07:00
Jon Fu 602335ed97 remove buggify off + reorder container listing + temp mute failing workload 2020-10-21 17:10:41 -04:00
Jon Fu 34c42bed9b Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent 2020-10-20 17:27:05 -04:00
Jon Fu d82dccd2ad revert systemkey clear in recovery tx and backupagent on restart, moved to workload specifically 2020-10-20 17:26:16 -04:00
Richard Chen 545ee4269d master conflicts 2020-10-19 01:03:54 +00:00
sfc-gh-tclinkenbeard c1d88b39ab Merge remote-tracking branch 'origin/master' into add-upgrade-and-backup-restore-test 2020-10-17 11:35:12 -07:00
Meng Xu 4d04a19fef CMakeList:Ignore ParallelRestoreOldBackupApiCorrectnessAtomicRestore test 2020-10-15 16:06:29 -07:00
Meng Xu c51c3e4ef1 CMakeList: Ignore ParallelRestoreOldBackupApiCorrectnessAtomicRestore test 2020-10-15 16:05:22 -07:00
Meng Xu 7102f8f11e test:Mute ParallelRestoreOldBackupApiCorrectnessAtomicRestore
Temporarily mute ParallelRestoreOldBackupApiCorrectnessAtomicRestore.toml test.
This only reduces the test for the fast restore on old backup format.
2020-10-15 15:44:29 -07:00
Meng Xu 64c7155305 test:mute ParallelRestoreOldBackupApiCorrectnessAtomicRestore temporarily 2020-10-15 15:24:58 -07:00
Jon Fu 2857a3df9d add retry limit to version gate 2020-10-14 14:31:51 -04:00
Jon Fu e096297bc1 add traces 2020-10-13 16:07:09 -04:00
Jon Fu bd9ff04af2 Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent 2020-10-13 13:14:09 -04:00
Jon Fu 48b9846a6a adjust test spec and manual g_simulator setting 2020-10-12 17:12:20 -04:00
Jon Fu b01cae5464 change test spec 2020-10-12 15:28:21 -04:00
Jon Fu ae4ba55445 Merge branch 'master' of https://github.com/apple/foundationdb into jfu-ibackup-correctness 2020-10-12 14:56:05 -04:00
Richard Chen 2f5b0bef08 switch to test newer incompatible version. Fix PR comments. Modify schema 2020-10-12 18:29:16 +00:00
Richard Chen 5488ff1d81 draft diff protocol 2020-10-12 18:24:03 +00:00
Richard Chen 41843f07e6 add simulator support for different process versions and ProtocolVersion test 2020-10-12 18:19:31 +00:00
Jon Fu 58d8dfdcaa initial commit 2020-10-12 13:11:51 -04:00
Jon Fu a968cd1dd4 disable test 2020-10-12 13:07:52 -04:00
Jon Fu cd5e3914bf Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-too-many-files 2020-10-12 13:07:25 -04:00
Jon Fu c48ca00a80 disable tests temporarily 2020-10-09 13:33:05 -04:00
Jon Fu be1ca196ee turn off consistency check until after restore (where we remove the backup agent) 2020-10-09 13:30:01 -04:00
Jon Fu 7218586f2f adjust test spec and backup describe 2020-10-06 17:03:09 -04:00
Jon Fu c0f857cd64 attempt to have logAntiQuorum as an option preset prior to starting simulation and running tests 2020-10-06 14:47:13 -04:00
Jon Fu b4ad989252 use stack transaction instead of heap 2020-10-05 16:51:01 -04:00
sfc-gh-tclinkenbeard a4cba5a162 Remove verifyOnly from Cycle workload 2020-10-05 13:19:12 -07:00
sfc-gh-tclinkenbeard 2b33e326c9 Make all restarting tests .txt, not .toml 2020-10-05 12:56:19 -07:00
sfc-gh-tclinkenbeard 9c2cc9ec56 Use toml for ConfigureTestRestart 2020-10-04 23:27:10 -07:00
sfc-gh-tclinkenbeard b4ffc04e4e Add UpgradeAndBackupRestore test 2020-10-04 23:27:10 -07:00
Jon Fu 8da8c6ff0d Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version 2020-09-30 14:25:29 -04:00
Jon Fu 44cd3b0999 add stopBackup to incrementalBackup workload 2020-09-30 14:24:52 -04:00
Andrew Noyes cd520dcf93
Merge pull request #3808 from sfc-gh-mpilman/features/ctest-client-smoketests
Add ability to run tests on fdb in ctest
2020-09-29 12:09:51 -07:00
Markus Pilman 2e7dcb6907 ask the OS to find a free port 2020-09-29 10:39:00 -06:00
Jon Fu 176fbd6a16 remove preset value in test spec 2020-09-28 17:37:17 -04:00
Jon Fu cfaa207f88 fix spacing and newlines at ends of files 2020-09-28 16:32:20 -04:00
Markus Pilman 94b7fcf823 fix typo 2020-09-28 14:20:58 -06:00
Jon Fu 57a80cfef2 added new SimpleAtomicAdd workload and adjusted SnapIncrementalRestore restarting test 2020-09-28 16:19:48 -04:00
Markus Pilman bf179dfbf3 Add better help text to tmp_cluster script 2020-09-28 14:17:08 -06:00
Markus Pilman 33d6c412c1 return error code correctly and cmake fixes 2020-09-24 15:58:41 -06:00
Markus Pilman 4c25214085 Add ability to run tests on fdb in ctest 2020-09-24 15:43:05 -06:00
Jon Fu a78da8b3ce Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version 2020-09-24 14:40:01 -04:00
Jon Fu 9fee52ba34 adjust test to include snapshot restore and ibackup together 2020-09-24 12:09:49 -04:00
Jon Fu 7553daba20 change waitVersion to waitForBackup 2020-09-23 16:13:30 -04:00
Jon Fu 69580593dd Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version 2020-09-23 15:35:05 -04:00
Jon Fu 285e2594ef adjusted delay and timing of version gate 2020-09-23 14:28:47 -04:00
Jon Fu 7780c24cbe Attempt to use version instead of test duration to have backup capture all changes 2020-09-21 14:45:29 -04:00
Jon Fu 9b7d75b6dd WIP 2020-09-21 13:41:35 -04:00
Jingyu Zhou ea27e4bd9c
Merge pull request #3772 from yliucode/rename
Rename master proxy as commit proxy
2020-09-16 20:06:50 -07:00
Young Liu cc5bc16bd8 Rename more places from proxy to commit proxy 2020-09-15 22:29:49 -07:00
Jon Fu 37d77ecb64 WIP of adding tests 2020-09-15 13:31:06 -04:00
Young Liu 35bef73a1c Rename proxy to commit proxy 2020-09-10 17:44:15 -07:00
Trevor Clinkenbeard 732a457ba4
Merge pull request #3720 from sfc-gh-xwang/mako
update mako and WriteTagThrottling workload so as to trigger tag throttling event
2020-09-10 15:21:00 -07:00
Jon Fu 0eb7092faa Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only 2020-09-08 12:53:29 -04:00
Xin Dong 4bab3f56df Disable readhot detection workload for now. 2020-09-04 10:01:58 -07:00
Young Liu 87693cae81 merge master branch and resolve conflicts 2020-09-02 13:44:33 -07:00
Xiaoxi Wang f930f9bbb6 update toml test spec 2020-09-02 05:25:40 +00:00
Jon Fu b9baa996e3 Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only 2020-09-01 14:38:02 -04:00
Evan Tschannen 7eeaf55f2b fixed conflicts with tests 2020-08-31 21:18:49 -07:00
Evan Tschannen 12edadd059 Merge branch 'release-6.3'
# Conflicts:
#	CMakeLists.txt
#	fdbclient/Knobs.cpp
#	fdbclient/MasterProxyInterface.h
#	fdbrpc/simulator.h
#	fdbserver/MasterProxyServer.actor.cpp
#	tests/fast/CycleAndLock.txt
#	tests/fast/TxnStateStoreCycleTest.txt
#	tests/fast/VersionStamp.txt
#	tests/slow/ParallelRestoreOldBackupApiCorrectnessAtomicRestore.txt
#	tests/slow/ParallelRestoreOldBackupCorrectnessCycle.txt
#	versions.target
2020-08-31 19:33:34 -07:00
Evan Tschannen 29eec30183 Merge branch 'release-6.2' into release-6.3
# Conflicts:
#	CMakeLists.txt
#	build/Dockerfile
#	build/Dockerfile.devel
#	documentation/sphinx/source/downloads.rst
#	fdbserver/Knobs.cpp
#	fdbserver/LogSystem.h
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/TagPartitionedLogSystem.actor.cpp
#	fdbserver/WaitFailure.actor.cpp
#	fdbserver/fdbserver.vcxproj
#	fdbserver/fdbserver.vcxproj.filters
#	packaging/msi/FDBInstaller.wxs
2020-08-31 01:10:29 -07:00
Jon Fu 4831f11e2a Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only 2020-08-28 12:47:19 -04:00
Jon Fu 0270ee13c8 change targetversion from maxlogend to contiguouslogend. also adjusted test workload and specs 2020-08-28 12:46:34 -04:00
Meng Xu ca486fdcd4 FastRestoreOldBackupTest:Revert workload time to 30s 2020-08-27 09:31:57 -07:00
Meng Xu 3d2b18b663 FastRestore:AtomicRestore:Add resetDBTimeout option 2020-08-26 10:21:17 -07:00
Meng Xu a8bd628216 FastRestoreAtomicRestoreTest:Increase timeout from 2100 to 36000 2020-08-26 09:48:52 -07:00
Meng Xu 1b7a0d9b1d FastRestoreTest:Increase cycle test duration from 40 to 60s 2020-08-25 22:47:39 -07:00
Meng Xu 57584f41a0 FastRestoreOldBackup:Change backup latency from 60 to 40s 2020-08-25 10:42:28 -07:00
Meng Xu 23c8d0154b FastRestoreOldBackupTest:Increase test duragion
Add comment on Rollback test as well
2020-08-25 09:14:37 -07:00
Young Liu 63b3612ad5 Merge master branch and resolve conflicts 2020-08-24 16:42:31 -07:00
David Youngworth e1b7dd0c7d Merge remote-tracking branch 'upstream/release-6.3' into dyoungworth/fixMerge1 2020-08-22 12:25:19 -07:00