Commit Graph

701 Commits

Author SHA1 Message Date
Josh Slocum ad90b03012
Merge pull request #4949 from sfc-gh-jslocum/tss_downgrade
TSS downgrade changes
2021-06-10 14:06:38 -07:00
Josh Slocum 59726545a4 TSS downgrade changes 2021-06-10 19:30:45 +00:00
Andrew Noyes eebba211ef 150 was too short and we were seeing false positives 2021-06-10 11:14:38 -07:00
A.J. Beamon 6f5ae9d76a
Merge pull request #4882 from sfc-gh-ajbeamon/restarting-test-increase-6.2-version
Require a minimum of 6.2.33 for 6.2 snapshot restarting tests
2021-06-01 09:42:07 -07:00
A.J. Beamon f28dae7c70 Require a minimum of 6.2.33 for 6.2 snapshot restarting tests to avoid a bug in prior versions 2021-05-28 12:43:30 -07:00
Josh Slocum ce82c9653e Testing Storage Server implementation 2021-05-25 20:28:50 +00:00
Markus Pilman 64608fe86b allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
Lukas Joswiak 6499fa178e
Merge pull request #4802 from sfc-gh-ljoswiak/revert/actor-lineage
Revert "Merge pull request #4136 from sfc-gh-mpilman/features/actor-l…
2021-05-11 18:50:42 -07:00
Chaoguang Lin ed3415c93e Guard the added unit test by NOT OPEN_FOR_IDE 2021-05-11 12:21:09 -07:00
Chaoguang Lin 804354f9b2 Merge branch 'master' of github.com:apple/foundationdb into refactor-fdbcli 2021-05-11 12:14:59 -07:00
Lukas Joswiak 4ea760b2a9 Revert "Merge pull request #4136 from sfc-gh-mpilman/features/actor-lineage"
This reverts commit da41534618, reversing
changes made to e6300905d6.
2021-05-10 20:26:12 -07:00
Edwin Zhang 3d9619790d Fix OPEN_FOR_IDE option for cmake 2021-05-07 17:54:59 -04:00
Chaoguang Lin 24247057ff Add two safeThreadFuture unit tests into ctest 2021-05-06 16:34:13 -07:00
Lukas Joswiak 8dcd779fc4
Merge branch 'master' into features/actor-lineage 2021-05-02 14:11:42 -07:00
A.J. Beamon 8eb78fd317
Merge pull request #4714 from sfc-gh-anoyes/anoyes/more-thread-safety-ctest
Add /fdbclient/multiversionclient/ to ctest, and fix thread safety
2021-04-28 08:54:16 -07:00
Markus Pilman 4fab2ecd30 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-28 09:20:54 -06:00
Andrew Noyes 6fc59379d8 Add /fdbclient/multiversionclient/ to ctest, and fix thread safety 2021-04-23 21:17:41 +00:00
Josh Slocum 4b5bca6761 Minor Redwood comparison optimizations 2021-04-23 18:49:43 +00:00
Russell Sears 77af97c7a3
Merge pull request #4622 from vishesh/task/fix-loopback-cluster
loopback_cluster: Find `fdbcli` from `$BUILD` path
2021-04-22 10:05:00 -07:00
Steve Atherton 9ee2cd7bcb Renamed prefixesAllowed again for clarity. 2021-04-20 11:54:40 -07:00
Steve Atherton 3c7dc1a59e Backup correctness workload bug fix. Sometimes the restore target ranges are empty, which causes a test timeout. Renamed some variables for clarity. 2021-04-19 21:36:47 -07:00
Markus Pilman 7307750e5e Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-19 11:29:52 -06:00
Markus Pilman a445e09c2d
Merge pull request #4617 from sfc-gh-satherton/unit-test-params
Added UnitTest parameters concept and ability to run unit tests directly from command line, with parameters
2021-04-15 14:59:15 -06:00
Steve Atherton 8616575c21 Merge commit 'd51f94f16ee903aa249ddaac0047c88cafac1e89' into unit-test-params 2021-04-14 18:23:00 -07:00
Jon Fu f6f225ccae Merge branch 'master' of github.com:apple/foundationdb into jfu-test-conf-options 2021-04-14 14:21:23 -04:00
Steve Atherton 6bcd997bb9 Merge commit '83cc3d3af058fdcb23a8681e0bf28cac7de3e61e' into unit-test-params 2021-04-14 10:04:55 -07:00
Markus Pilman 1d362d8869 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-14 09:55:04 -06:00
Steve Atherton 1c5013f6ec Removed btree cleanup parameter override. 2021-04-13 20:19:25 -07:00
Andrew Noyes eb4c80db39 Respect the version constraints for restart tests in ctest 2021-04-12 23:15:17 +00:00
Jon Fu 57d24263ef Merge branch 'master' of github.com:apple/foundationdb into jfu-test-conf-options 2021-04-12 13:23:18 -04:00
Aaron Molitor 2de2ebd337 add old fdb binaries to build image, update cmake to look in the right place, add new alias to devel image, update FDBTLS lib install for joshua, get the default joshua branch 2021-04-08 12:05:59 -05:00
Steve Atherton 7b08886caf Updated btree unit test name. 2021-04-07 18:29:17 -07:00
Jon Fu 2a64c227fb Added options to test config that specify maxtlogversion and array of excluded storage engine types 2021-04-07 15:59:51 -04:00
Vishesh Yadav cf33cea0b4 loopback_cluster: Find `fdbcli` from `$BUILD` path
Currently expects to find `fdbcli` in current path, which doesn't seem
right. `fdbcli` should always be in the directory where we'll find
`fdbserver`.
2021-04-06 13:44:33 +00:00
Steve Atherton e7573d546f Some unit tests names had a prefixed "!" in order to be excluded from random selection, this has been changed to a ":" as it is less problematic on the command line. Some Redwood unit tests have been enabled for random selection. 2021-04-05 00:03:15 -07:00
Markus Pilman dc35af3760 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-01 11:01:31 -06:00
Jon Fu 69d88dcf96 adjust placement of option in test workload 2021-03-25 15:25:50 -04:00
Jon Fu 1541f4234a Updated test parser with new option and also added option to test file with default value 2021-03-25 14:40:06 -04:00
Markus Pilman eb036b7b02 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-03-17 11:59:54 -06:00
A.J. Beamon 25c4880ebe Merge branch 'release-6.3' into merge-release-6.3-into-master (temporarily discard all changes to BackupContainer.actor.cpp)
# Conflicts:
#	fdbclient/BackupContainer.actor.cpp
#	fdbserver/Knobs.h
2021-03-15 16:41:04 -07:00
A.J. Beamon b7614bad24 Update the multithreaded_client test to work with Python 3 2021-03-10 16:47:33 -08:00
Andrew Noyes 18ee11e69a Use add_fdbclient_test for java integration tests
Also change add_fdbclient_test to run its subcommand with FDB_CLUSTER_FILE set
2021-03-02 01:54:17 +00:00
negoyal e9b7e22e02 Merge branch 'rel-6.3' 2021-02-22 08:47:22 -08:00
Russell Sears 555f3ebfaa Implement + test corner case configurations for mutlithreaded client. 2021-02-12 22:37:24 +00:00
Russell Sears 4938aee113 Address PR comments, remove some old cruft + comments 2021-02-11 01:27:57 +00:00
Russell Sears cd2fe438ff Harness to spawn multiple FDB clusters, and Vishesh's python multithreaded client test 2021-02-11 01:10:29 +00:00
Nim Wijetunga 3b48942f9a resolve pr comments 2021-02-09 17:56:30 -05:00
Nim Wijetunga 2560dc0227 add test workload 2021-02-09 12:32:37 -05:00
Steve Atherton d718e7baf3
Merge pull request #4179 from sfc-gh-tclinkenbeard/run-minio-joshua
Support Testing S3BlobStore backup in simulation
2021-01-26 14:39:57 -08:00
Andrew Noyes 6a40b007e6 Resolve conflicts 2021-01-25 18:57:12 +00:00
Andrew Noyes adde95bea5 Merge branch 'release-6.3' into anoyes/merge-6.3-to-master
Commit merge conflicts for now
2021-01-25 18:55:24 +00:00
sfc-gh-tclinkenbeard 51cbc494f1 Merge remote-tracking branch 'origin/master' into run-minio-joshua 2021-01-23 11:31:19 -08:00
Andrew Noyes 58b4a9b907 Resolve conflicts 2021-01-21 20:59:44 +00:00
Andrew Noyes 281151ff20 Merge remote-tracking branch 'upstream/release-6.2' into anoyes/merge-6.2-to-6.3
Commit conflict markers for now
2021-01-21 17:54:26 +00:00
Andrew Noyes ff7d306b09 Merge branch 'release-6.3' into anoyes/merge-6.3-to-master
Include conflict markers for now. Will resolve.
2021-01-15 18:04:09 +00:00
Andrew Noyes ddb5b0b050 Backport correctness package 2021-01-15 00:34:47 +00:00
Markus Pilman 8e93573aad Merge branch 'master' of github.com:apple/foundationdb into features/actor-lineage 2021-01-05 10:24:45 -07:00
sfc-gh-tclinkenbeard 61a29ecfc8 Merge remote-tracking branch 'origin/master' into run-minio-joshua 2021-01-01 09:38:36 -04:00
sfc-gh-tclinkenbeard 2a8f971733 Fix Azure blob storage backup test 2020-12-24 21:20:05 -04:00
sfc-gh-tclinkenbeard 1dc0343092 Update blob backup test files 2020-12-24 21:20:05 -04:00
Andrew Noyes 9601769b01
Merge pull request #3858 from sfc-gh-rchen/stable_interfaces
Stable interfaces
2020-12-11 09:34:27 -08:00
Markus Pilman f8e1df6c4f Support for actor stack traces 2020-12-10 10:42:04 -07:00
sfc-gh-tclinkenbeard aa351d37d3 Increase stable snapshot lower bound to 6.2.29 2020-12-09 10:44:26 -08:00
Andrew Noyes 7fbc4d7391 Resolve conflicts 2020-12-04 23:58:42 +00:00
Andrew Noyes 877997632d Merge branch 'release-6.3' into anoyes/merge-release-6.3-master
Include conflict markers for review purposes
2020-12-04 01:38:07 +00:00
Richard Chen c77d9e4abe merge conflicts 2020-12-02 21:53:19 +00:00
sfc-gh-tclinkenbeard 882b77eae0 Change earliest downgrade version to 6.3.10
Because FDB7 will write xxhash3 checksums for sqlite pages, and these
are not read by 6.3 until patch 6.3.10, the downgrade tests should only
attempt to versions >=6.3.10
2020-11-24 00:28:53 -08:00
sfc-gh-tclinkenbeard 16f68babd3 Ignore downgrade testing for now
Since we're writing xxhash3 checksums that 6.3 can't yet understand,
these tests would fail currently.
2020-11-21 20:18:33 -08:00
sfc-gh-tclinkenbeard 45c9a0abc7 Revert "Revert "Add limiting health metrics""
This reverts commit 209ebcc595.
2020-11-13 17:24:57 -08:00
Trevor Clinkenbeard 209ebcc595
Revert "Add limiting health metrics" 2020-11-13 17:08:46 -08:00
Trevor Clinkenbeard 8c0b4dbe4c
Merge pull request #4067 from sfc-gh-tclinkenbeard/add-limiting-health-metrics
Add limiting health metrics
2020-11-13 16:04:44 -08:00
sfc-gh-tclinkenbeard 9bb93dadf1 Reenabled Throttling.toml test (as a rare test) 2020-11-13 11:34:32 -08:00
sfc-gh-tclinkenbeard ac89b60c7d Remove reference to non-existant WriteTagThrottling.txt 2020-11-12 20:15:10 -08:00
Markus Pilman 0f205620bf
Merge branch 'master' into features/udp 2020-11-12 13:51:17 -07:00
Jon Fu 1eff31b0e5 don't run consistency check until after the backup is discontinued 2020-11-09 13:22:41 -05:00
sfc-gh-tclinkenbeard d134c2cb14 Make sure only uppercase characters follow underscore in test titles
These test titles are used in trace lines, so having an underscore
followed by a lower-case character leads to invalid trace lines
2020-11-08 14:30:55 -08:00
Jon Fu ac0e4c1705 unpause backup as soon as possible when waiting for version 2020-11-04 15:13:02 -05:00
Jon Fu bda72d9a3d first draft at changing snapshot backup behaviour 2020-11-02 17:12:30 -05:00
Richard Chen 9c6c2704d0 Merge branch 'master' of https://github.com/apple/foundationdb into stable_interfaces 2020-10-30 23:59:32 +00:00
sfc-gh-tclinkenbeard 55e86c1336 Disambiguate between S3BlobStore and other blob stores 2020-10-29 20:42:23 -07:00
Steve Atherton 96cc700440
Merge pull request #3961 from sfc-gh-tclinkenbeard/azure-backup
Add support for writing backup files directly to Azure blob storage
2020-10-29 00:30:40 -07:00
sfc-gh-tclinkenbeard 95e5130903 Don't rewrite BeforeRestart prefix in UpgradeAndBackupRestore-2 2020-10-28 14:06:40 -07:00
sfc-gh-tclinkenbeard e389a5dabe Fix issues with Azure credentials 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard c6739f7075 Add skeleton for BackupContainerAzureBlobStore::listURLs 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard f3c52ed41e Guard Azure backup compilation behind CMake variable 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard e9de39f525 Add machine attrition to BackupBlobCorrectness test 2020-10-24 16:48:00 -07:00
sfc-gh-tclinkenbeard 273ea97879 Renamed BackupToBlob.toml BackupBlobCorrectness.toml 2020-10-24 16:47:59 -07:00
sfc-gh-tclinkenbeard 82b6daa16b First draft of Azure blob storage backup container 2020-10-24 16:47:51 -07:00
Richard Chen 055add9682 conflicts 2020-10-23 06:33:00 +00:00
sfc-gh-tclinkenbeard 6877e0ee4f Merge remote-tracking branch 'origin/master' into fix-upgrade-and-backup-test 2020-10-22 14:07:34 -07:00
sfc-gh-tclinkenbeard 09d5ed9cb4 Fix typo in UpgradeAndBackupRestore-2.toml 2020-10-22 13:09:41 -07:00
sfc-gh-tclinkenbeard d47642f37d Disable consistency check for first test of UpgradeAndBackupRestore 2020-10-22 12:57:05 -07:00
sfc-gh-tclinkenbeard 9d8f831214 Use toml for UpgradeAndBackupRestore test files 2020-10-21 20:36:12 -07:00
sfc-gh-tclinkenbeard 313d4aae58 Disable consistency check in UpgradeAndBackupRestore test until backup is stopped 2020-10-21 20:23:20 -07:00
Jon Fu 602335ed97 remove buggify off + reorder container listing + temp mute failing workload 2020-10-21 17:10:41 -04:00
Jon Fu 34c42bed9b Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent 2020-10-20 17:27:05 -04:00
Jon Fu d82dccd2ad revert systemkey clear in recovery tx and backupagent on restart, moved to workload specifically 2020-10-20 17:26:16 -04:00
Richard Chen 545ee4269d master conflicts 2020-10-19 01:03:54 +00:00
sfc-gh-tclinkenbeard c1d88b39ab Merge remote-tracking branch 'origin/master' into add-upgrade-and-backup-restore-test 2020-10-17 11:35:12 -07:00
Meng Xu 4d04a19fef CMakeList:Ignore ParallelRestoreOldBackupApiCorrectnessAtomicRestore test 2020-10-15 16:06:29 -07:00
Meng Xu c51c3e4ef1 CMakeList: Ignore ParallelRestoreOldBackupApiCorrectnessAtomicRestore test 2020-10-15 16:05:22 -07:00
Meng Xu 7102f8f11e test:Mute ParallelRestoreOldBackupApiCorrectnessAtomicRestore
Temporarily mute ParallelRestoreOldBackupApiCorrectnessAtomicRestore.toml test.
This only reduces the test for the fast restore on old backup format.
2020-10-15 15:44:29 -07:00
Meng Xu 64c7155305 test:mute ParallelRestoreOldBackupApiCorrectnessAtomicRestore temporarily 2020-10-15 15:24:58 -07:00
Jon Fu 2857a3df9d add retry limit to version gate 2020-10-14 14:31:51 -04:00
Jon Fu e096297bc1 add traces 2020-10-13 16:07:09 -04:00
Jon Fu bd9ff04af2 Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent 2020-10-13 13:14:09 -04:00
Jon Fu 48b9846a6a adjust test spec and manual g_simulator setting 2020-10-12 17:12:20 -04:00
Jon Fu b01cae5464 change test spec 2020-10-12 15:28:21 -04:00
Jon Fu ae4ba55445 Merge branch 'master' of https://github.com/apple/foundationdb into jfu-ibackup-correctness 2020-10-12 14:56:05 -04:00
Richard Chen 2f5b0bef08 switch to test newer incompatible version. Fix PR comments. Modify schema 2020-10-12 18:29:16 +00:00
Richard Chen 5488ff1d81 draft diff protocol 2020-10-12 18:24:03 +00:00
Richard Chen 41843f07e6 add simulator support for different process versions and ProtocolVersion test 2020-10-12 18:19:31 +00:00
Jon Fu 58d8dfdcaa initial commit 2020-10-12 13:11:51 -04:00
Jon Fu a968cd1dd4 disable test 2020-10-12 13:07:52 -04:00
Jon Fu cd5e3914bf Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-too-many-files 2020-10-12 13:07:25 -04:00
Jon Fu c48ca00a80 disable tests temporarily 2020-10-09 13:33:05 -04:00
Jon Fu be1ca196ee turn off consistency check until after restore (where we remove the backup agent) 2020-10-09 13:30:01 -04:00
Jon Fu 7218586f2f adjust test spec and backup describe 2020-10-06 17:03:09 -04:00
Jon Fu c0f857cd64 attempt to have logAntiQuorum as an option preset prior to starting simulation and running tests 2020-10-06 14:47:13 -04:00
Jon Fu b4ad989252 use stack transaction instead of heap 2020-10-05 16:51:01 -04:00
sfc-gh-tclinkenbeard a4cba5a162 Remove verifyOnly from Cycle workload 2020-10-05 13:19:12 -07:00
sfc-gh-tclinkenbeard 2b33e326c9 Make all restarting tests .txt, not .toml 2020-10-05 12:56:19 -07:00
sfc-gh-tclinkenbeard 9c2cc9ec56 Use toml for ConfigureTestRestart 2020-10-04 23:27:10 -07:00
sfc-gh-tclinkenbeard b4ffc04e4e Add UpgradeAndBackupRestore test 2020-10-04 23:27:10 -07:00
Jon Fu 8da8c6ff0d Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version 2020-09-30 14:25:29 -04:00
Jon Fu 44cd3b0999 add stopBackup to incrementalBackup workload 2020-09-30 14:24:52 -04:00
Andrew Noyes cd520dcf93
Merge pull request #3808 from sfc-gh-mpilman/features/ctest-client-smoketests
Add ability to run tests on fdb in ctest
2020-09-29 12:09:51 -07:00
Markus Pilman 2e7dcb6907 ask the OS to find a free port 2020-09-29 10:39:00 -06:00
Jon Fu 176fbd6a16 remove preset value in test spec 2020-09-28 17:37:17 -04:00
Jon Fu cfaa207f88 fix spacing and newlines at ends of files 2020-09-28 16:32:20 -04:00
Markus Pilman 94b7fcf823 fix typo 2020-09-28 14:20:58 -06:00
Jon Fu 57a80cfef2 added new SimpleAtomicAdd workload and adjusted SnapIncrementalRestore restarting test 2020-09-28 16:19:48 -04:00
Markus Pilman bf179dfbf3 Add better help text to tmp_cluster script 2020-09-28 14:17:08 -06:00
Markus Pilman 33d6c412c1 return error code correctly and cmake fixes 2020-09-24 15:58:41 -06:00
Markus Pilman 4c25214085 Add ability to run tests on fdb in ctest 2020-09-24 15:43:05 -06:00
Jon Fu a78da8b3ce Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version 2020-09-24 14:40:01 -04:00
Jon Fu 9fee52ba34 adjust test to include snapshot restore and ibackup together 2020-09-24 12:09:49 -04:00
Jon Fu 7553daba20 change waitVersion to waitForBackup 2020-09-23 16:13:30 -04:00
Jon Fu 69580593dd Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version 2020-09-23 15:35:05 -04:00
Jon Fu 285e2594ef adjusted delay and timing of version gate 2020-09-23 14:28:47 -04:00
Jon Fu 7780c24cbe Attempt to use version instead of test duration to have backup capture all changes 2020-09-21 14:45:29 -04:00
Jon Fu 9b7d75b6dd WIP 2020-09-21 13:41:35 -04:00
Jingyu Zhou ea27e4bd9c
Merge pull request #3772 from yliucode/rename
Rename master proxy as commit proxy
2020-09-16 20:06:50 -07:00
Young Liu cc5bc16bd8 Rename more places from proxy to commit proxy 2020-09-15 22:29:49 -07:00
Jon Fu 37d77ecb64 WIP of adding tests 2020-09-15 13:31:06 -04:00
Young Liu 35bef73a1c Rename proxy to commit proxy 2020-09-10 17:44:15 -07:00
Trevor Clinkenbeard 732a457ba4
Merge pull request #3720 from sfc-gh-xwang/mako
update mako and WriteTagThrottling workload so as to trigger tag throttling event
2020-09-10 15:21:00 -07:00
Jon Fu 0eb7092faa Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only 2020-09-08 12:53:29 -04:00
Xin Dong 4bab3f56df Disable readhot detection workload for now. 2020-09-04 10:01:58 -07:00
Young Liu 87693cae81 merge master branch and resolve conflicts 2020-09-02 13:44:33 -07:00