Commit Graph

793 Commits

Author SHA1 Message Date
Chaoguang Lin ed3415c93e Guard the added unit test by NOT OPEN_FOR_IDE 2021-05-11 12:21:09 -07:00
Chaoguang Lin 804354f9b2 Merge branch 'master' of github.com:apple/foundationdb into refactor-fdbcli 2021-05-11 12:14:59 -07:00
Lukas Joswiak 4ea760b2a9 Revert "Merge pull request #4136 from sfc-gh-mpilman/features/actor-lineage"
This reverts commit da41534618, reversing
changes made to e6300905d6.
2021-05-10 20:26:12 -07:00
Edwin Zhang 3d9619790d Fix OPEN_FOR_IDE option for cmake 2021-05-07 17:54:59 -04:00
Chaoguang Lin 24247057ff Add two safeThreadFuture unit tests into ctest 2021-05-06 16:34:13 -07:00
Lukas Joswiak 8dcd779fc4
Merge branch 'master' into features/actor-lineage 2021-05-02 14:11:42 -07:00
A.J. Beamon 8eb78fd317
Merge pull request #4714 from sfc-gh-anoyes/anoyes/more-thread-safety-ctest
Add /fdbclient/multiversionclient/ to ctest, and fix thread safety
2021-04-28 08:54:16 -07:00
Markus Pilman 4fab2ecd30 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-28 09:20:54 -06:00
Andrew Noyes 6fc59379d8 Add /fdbclient/multiversionclient/ to ctest, and fix thread safety 2021-04-23 21:17:41 +00:00
Josh Slocum 4b5bca6761 Minor Redwood comparison optimizations 2021-04-23 18:49:43 +00:00
Russell Sears 77af97c7a3
Merge pull request #4622 from vishesh/task/fix-loopback-cluster
loopback_cluster: Find `fdbcli` from `$BUILD` path
2021-04-22 10:05:00 -07:00
Steve Atherton 9ee2cd7bcb Renamed prefixesAllowed again for clarity. 2021-04-20 11:54:40 -07:00
Steve Atherton 3c7dc1a59e Backup correctness workload bug fix. Sometimes the restore target ranges are empty, which causes a test timeout. Renamed some variables for clarity. 2021-04-19 21:36:47 -07:00
Markus Pilman 7307750e5e Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-19 11:29:52 -06:00
Markus Pilman a445e09c2d
Merge pull request #4617 from sfc-gh-satherton/unit-test-params
Added UnitTest parameters concept and ability to run unit tests directly from command line, with parameters
2021-04-15 14:59:15 -06:00
Steve Atherton 8616575c21 Merge commit 'd51f94f16ee903aa249ddaac0047c88cafac1e89' into unit-test-params 2021-04-14 18:23:00 -07:00
Jon Fu f6f225ccae Merge branch 'master' of github.com:apple/foundationdb into jfu-test-conf-options 2021-04-14 14:21:23 -04:00
Steve Atherton 6bcd997bb9 Merge commit '83cc3d3af058fdcb23a8681e0bf28cac7de3e61e' into unit-test-params 2021-04-14 10:04:55 -07:00
Markus Pilman 1d362d8869 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-14 09:55:04 -06:00
Steve Atherton 1c5013f6ec Removed btree cleanup parameter override. 2021-04-13 20:19:25 -07:00
Andrew Noyes eb4c80db39 Respect the version constraints for restart tests in ctest 2021-04-12 23:15:17 +00:00
Jon Fu 57d24263ef Merge branch 'master' of github.com:apple/foundationdb into jfu-test-conf-options 2021-04-12 13:23:18 -04:00
Aaron Molitor 2de2ebd337 add old fdb binaries to build image, update cmake to look in the right place, add new alias to devel image, update FDBTLS lib install for joshua, get the default joshua branch 2021-04-08 12:05:59 -05:00
Steve Atherton 7b08886caf Updated btree unit test name. 2021-04-07 18:29:17 -07:00
Jon Fu 2a64c227fb Added options to test config that specify maxtlogversion and array of excluded storage engine types 2021-04-07 15:59:51 -04:00
Vishesh Yadav cf33cea0b4 loopback_cluster: Find `fdbcli` from `$BUILD` path
Currently expects to find `fdbcli` in current path, which doesn't seem
right. `fdbcli` should always be in the directory where we'll find
`fdbserver`.
2021-04-06 13:44:33 +00:00
Steve Atherton e7573d546f Some unit tests names had a prefixed "!" in order to be excluded from random selection, this has been changed to a ":" as it is less problematic on the command line. Some Redwood unit tests have been enabled for random selection. 2021-04-05 00:03:15 -07:00
Markus Pilman dc35af3760 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-01 11:01:31 -06:00
Jon Fu 69d88dcf96 adjust placement of option in test workload 2021-03-25 15:25:50 -04:00
Jon Fu 1541f4234a Updated test parser with new option and also added option to test file with default value 2021-03-25 14:40:06 -04:00
Markus Pilman eb036b7b02 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-03-17 11:59:54 -06:00
A.J. Beamon 25c4880ebe Merge branch 'release-6.3' into merge-release-6.3-into-master (temporarily discard all changes to BackupContainer.actor.cpp)
# Conflicts:
#	fdbclient/BackupContainer.actor.cpp
#	fdbserver/Knobs.h
2021-03-15 16:41:04 -07:00
A.J. Beamon b7614bad24 Update the multithreaded_client test to work with Python 3 2021-03-10 16:47:33 -08:00
Andrew Noyes 18ee11e69a Use add_fdbclient_test for java integration tests
Also change add_fdbclient_test to run its subcommand with FDB_CLUSTER_FILE set
2021-03-02 01:54:17 +00:00
negoyal e9b7e22e02 Merge branch 'rel-6.3' 2021-02-22 08:47:22 -08:00
Russell Sears 555f3ebfaa Implement + test corner case configurations for mutlithreaded client. 2021-02-12 22:37:24 +00:00
Russell Sears 4938aee113 Address PR comments, remove some old cruft + comments 2021-02-11 01:27:57 +00:00
Russell Sears cd2fe438ff Harness to spawn multiple FDB clusters, and Vishesh's python multithreaded client test 2021-02-11 01:10:29 +00:00
Nim Wijetunga 3b48942f9a resolve pr comments 2021-02-09 17:56:30 -05:00
Nim Wijetunga 2560dc0227 add test workload 2021-02-09 12:32:37 -05:00
Steve Atherton d718e7baf3
Merge pull request #4179 from sfc-gh-tclinkenbeard/run-minio-joshua
Support Testing S3BlobStore backup in simulation
2021-01-26 14:39:57 -08:00
Andrew Noyes 6a40b007e6 Resolve conflicts 2021-01-25 18:57:12 +00:00
Andrew Noyes adde95bea5 Merge branch 'release-6.3' into anoyes/merge-6.3-to-master
Commit merge conflicts for now
2021-01-25 18:55:24 +00:00
sfc-gh-tclinkenbeard 51cbc494f1 Merge remote-tracking branch 'origin/master' into run-minio-joshua 2021-01-23 11:31:19 -08:00
Andrew Noyes 58b4a9b907 Resolve conflicts 2021-01-21 20:59:44 +00:00
Andrew Noyes 281151ff20 Merge remote-tracking branch 'upstream/release-6.2' into anoyes/merge-6.2-to-6.3
Commit conflict markers for now
2021-01-21 17:54:26 +00:00
Andrew Noyes ff7d306b09 Merge branch 'release-6.3' into anoyes/merge-6.3-to-master
Include conflict markers for now. Will resolve.
2021-01-15 18:04:09 +00:00
Andrew Noyes ddb5b0b050 Backport correctness package 2021-01-15 00:34:47 +00:00
Markus Pilman 8e93573aad Merge branch 'master' of github.com:apple/foundationdb into features/actor-lineage 2021-01-05 10:24:45 -07:00
sfc-gh-tclinkenbeard 61a29ecfc8 Merge remote-tracking branch 'origin/master' into run-minio-joshua 2021-01-01 09:38:36 -04:00
sfc-gh-tclinkenbeard 2a8f971733 Fix Azure blob storage backup test 2020-12-24 21:20:05 -04:00
sfc-gh-tclinkenbeard 1dc0343092 Update blob backup test files 2020-12-24 21:20:05 -04:00
Andrew Noyes 9601769b01
Merge pull request #3858 from sfc-gh-rchen/stable_interfaces
Stable interfaces
2020-12-11 09:34:27 -08:00
Markus Pilman f8e1df6c4f Support for actor stack traces 2020-12-10 10:42:04 -07:00
sfc-gh-tclinkenbeard aa351d37d3 Increase stable snapshot lower bound to 6.2.29 2020-12-09 10:44:26 -08:00
Andrew Noyes 7fbc4d7391 Resolve conflicts 2020-12-04 23:58:42 +00:00
Andrew Noyes 877997632d Merge branch 'release-6.3' into anoyes/merge-release-6.3-master
Include conflict markers for review purposes
2020-12-04 01:38:07 +00:00
Richard Chen c77d9e4abe merge conflicts 2020-12-02 21:53:19 +00:00
sfc-gh-tclinkenbeard 882b77eae0 Change earliest downgrade version to 6.3.10
Because FDB7 will write xxhash3 checksums for sqlite pages, and these
are not read by 6.3 until patch 6.3.10, the downgrade tests should only
attempt to versions >=6.3.10
2020-11-24 00:28:53 -08:00
sfc-gh-tclinkenbeard 16f68babd3 Ignore downgrade testing for now
Since we're writing xxhash3 checksums that 6.3 can't yet understand,
these tests would fail currently.
2020-11-21 20:18:33 -08:00
sfc-gh-tclinkenbeard 45c9a0abc7 Revert "Revert "Add limiting health metrics""
This reverts commit 209ebcc595.
2020-11-13 17:24:57 -08:00
Trevor Clinkenbeard 209ebcc595
Revert "Add limiting health metrics" 2020-11-13 17:08:46 -08:00
Trevor Clinkenbeard 8c0b4dbe4c
Merge pull request #4067 from sfc-gh-tclinkenbeard/add-limiting-health-metrics
Add limiting health metrics
2020-11-13 16:04:44 -08:00
sfc-gh-tclinkenbeard 9bb93dadf1 Reenabled Throttling.toml test (as a rare test) 2020-11-13 11:34:32 -08:00
sfc-gh-tclinkenbeard ac89b60c7d Remove reference to non-existant WriteTagThrottling.txt 2020-11-12 20:15:10 -08:00
Markus Pilman 0f205620bf
Merge branch 'master' into features/udp 2020-11-12 13:51:17 -07:00
Jon Fu 1eff31b0e5 don't run consistency check until after the backup is discontinued 2020-11-09 13:22:41 -05:00
sfc-gh-tclinkenbeard d134c2cb14 Make sure only uppercase characters follow underscore in test titles
These test titles are used in trace lines, so having an underscore
followed by a lower-case character leads to invalid trace lines
2020-11-08 14:30:55 -08:00
Jon Fu ac0e4c1705 unpause backup as soon as possible when waiting for version 2020-11-04 15:13:02 -05:00
Jon Fu bda72d9a3d first draft at changing snapshot backup behaviour 2020-11-02 17:12:30 -05:00
Richard Chen 9c6c2704d0 Merge branch 'master' of https://github.com/apple/foundationdb into stable_interfaces 2020-10-30 23:59:32 +00:00
sfc-gh-tclinkenbeard 55e86c1336 Disambiguate between S3BlobStore and other blob stores 2020-10-29 20:42:23 -07:00
Steve Atherton 96cc700440
Merge pull request #3961 from sfc-gh-tclinkenbeard/azure-backup
Add support for writing backup files directly to Azure blob storage
2020-10-29 00:30:40 -07:00
sfc-gh-tclinkenbeard 95e5130903 Don't rewrite BeforeRestart prefix in UpgradeAndBackupRestore-2 2020-10-28 14:06:40 -07:00
sfc-gh-tclinkenbeard e389a5dabe Fix issues with Azure credentials 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard c6739f7075 Add skeleton for BackupContainerAzureBlobStore::listURLs 2020-10-24 16:48:05 -07:00
sfc-gh-tclinkenbeard f3c52ed41e Guard Azure backup compilation behind CMake variable 2020-10-24 16:48:04 -07:00
sfc-gh-tclinkenbeard e9de39f525 Add machine attrition to BackupBlobCorrectness test 2020-10-24 16:48:00 -07:00
sfc-gh-tclinkenbeard 273ea97879 Renamed BackupToBlob.toml BackupBlobCorrectness.toml 2020-10-24 16:47:59 -07:00
sfc-gh-tclinkenbeard 82b6daa16b First draft of Azure blob storage backup container 2020-10-24 16:47:51 -07:00
Richard Chen 055add9682 conflicts 2020-10-23 06:33:00 +00:00
sfc-gh-tclinkenbeard 6877e0ee4f Merge remote-tracking branch 'origin/master' into fix-upgrade-and-backup-test 2020-10-22 14:07:34 -07:00
sfc-gh-tclinkenbeard 09d5ed9cb4 Fix typo in UpgradeAndBackupRestore-2.toml 2020-10-22 13:09:41 -07:00
sfc-gh-tclinkenbeard d47642f37d Disable consistency check for first test of UpgradeAndBackupRestore 2020-10-22 12:57:05 -07:00
sfc-gh-tclinkenbeard 9d8f831214 Use toml for UpgradeAndBackupRestore test files 2020-10-21 20:36:12 -07:00
sfc-gh-tclinkenbeard 313d4aae58 Disable consistency check in UpgradeAndBackupRestore test until backup is stopped 2020-10-21 20:23:20 -07:00
Jon Fu 602335ed97 remove buggify off + reorder container listing + temp mute failing workload 2020-10-21 17:10:41 -04:00
Jon Fu 34c42bed9b Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent 2020-10-20 17:27:05 -04:00
Jon Fu d82dccd2ad revert systemkey clear in recovery tx and backupagent on restart, moved to workload specifically 2020-10-20 17:26:16 -04:00
Richard Chen 545ee4269d master conflicts 2020-10-19 01:03:54 +00:00
sfc-gh-tclinkenbeard c1d88b39ab Merge remote-tracking branch 'origin/master' into add-upgrade-and-backup-restore-test 2020-10-17 11:35:12 -07:00
Meng Xu 4d04a19fef CMakeList:Ignore ParallelRestoreOldBackupApiCorrectnessAtomicRestore test 2020-10-15 16:06:29 -07:00
Meng Xu c51c3e4ef1 CMakeList: Ignore ParallelRestoreOldBackupApiCorrectnessAtomicRestore test 2020-10-15 16:05:22 -07:00
Meng Xu 7102f8f11e test:Mute ParallelRestoreOldBackupApiCorrectnessAtomicRestore
Temporarily mute ParallelRestoreOldBackupApiCorrectnessAtomicRestore.toml test.
This only reduces the test for the fast restore on old backup format.
2020-10-15 15:44:29 -07:00
Meng Xu 64c7155305 test:mute ParallelRestoreOldBackupApiCorrectnessAtomicRestore temporarily 2020-10-15 15:24:58 -07:00
Jon Fu 2857a3df9d add retry limit to version gate 2020-10-14 14:31:51 -04:00
Jon Fu e096297bc1 add traces 2020-10-13 16:07:09 -04:00
Jon Fu bd9ff04af2 Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-snapshot-backup-agent 2020-10-13 13:14:09 -04:00
Jon Fu 48b9846a6a adjust test spec and manual g_simulator setting 2020-10-12 17:12:20 -04:00
Jon Fu b01cae5464 change test spec 2020-10-12 15:28:21 -04:00
Jon Fu ae4ba55445 Merge branch 'master' of https://github.com/apple/foundationdb into jfu-ibackup-correctness 2020-10-12 14:56:05 -04:00
Richard Chen 2f5b0bef08 switch to test newer incompatible version. Fix PR comments. Modify schema 2020-10-12 18:29:16 +00:00
Richard Chen 5488ff1d81 draft diff protocol 2020-10-12 18:24:03 +00:00
Richard Chen 41843f07e6 add simulator support for different process versions and ProtocolVersion test 2020-10-12 18:19:31 +00:00
Jon Fu 58d8dfdcaa initial commit 2020-10-12 13:11:51 -04:00
Jon Fu a968cd1dd4 disable test 2020-10-12 13:07:52 -04:00
Jon Fu cd5e3914bf Merge branch 'master' of https://github.com/apple/foundationdb into jfu-fix-too-many-files 2020-10-12 13:07:25 -04:00
Jon Fu c48ca00a80 disable tests temporarily 2020-10-09 13:33:05 -04:00
Jon Fu be1ca196ee turn off consistency check until after restore (where we remove the backup agent) 2020-10-09 13:30:01 -04:00
Jon Fu 7218586f2f adjust test spec and backup describe 2020-10-06 17:03:09 -04:00
Jon Fu c0f857cd64 attempt to have logAntiQuorum as an option preset prior to starting simulation and running tests 2020-10-06 14:47:13 -04:00
Jon Fu b4ad989252 use stack transaction instead of heap 2020-10-05 16:51:01 -04:00
sfc-gh-tclinkenbeard a4cba5a162 Remove verifyOnly from Cycle workload 2020-10-05 13:19:12 -07:00
sfc-gh-tclinkenbeard 2b33e326c9 Make all restarting tests .txt, not .toml 2020-10-05 12:56:19 -07:00
sfc-gh-tclinkenbeard 9c2cc9ec56 Use toml for ConfigureTestRestart 2020-10-04 23:27:10 -07:00
sfc-gh-tclinkenbeard b4ffc04e4e Add UpgradeAndBackupRestore test 2020-10-04 23:27:10 -07:00
Jon Fu 8da8c6ff0d Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version 2020-09-30 14:25:29 -04:00
Jon Fu 44cd3b0999 add stopBackup to incrementalBackup workload 2020-09-30 14:24:52 -04:00
Andrew Noyes cd520dcf93
Merge pull request #3808 from sfc-gh-mpilman/features/ctest-client-smoketests
Add ability to run tests on fdb in ctest
2020-09-29 12:09:51 -07:00
Markus Pilman 2e7dcb6907 ask the OS to find a free port 2020-09-29 10:39:00 -06:00
Jon Fu 176fbd6a16 remove preset value in test spec 2020-09-28 17:37:17 -04:00
Jon Fu cfaa207f88 fix spacing and newlines at ends of files 2020-09-28 16:32:20 -04:00
Markus Pilman 94b7fcf823 fix typo 2020-09-28 14:20:58 -06:00
Jon Fu 57a80cfef2 added new SimpleAtomicAdd workload and adjusted SnapIncrementalRestore restarting test 2020-09-28 16:19:48 -04:00
Markus Pilman bf179dfbf3 Add better help text to tmp_cluster script 2020-09-28 14:17:08 -06:00
Markus Pilman 33d6c412c1 return error code correctly and cmake fixes 2020-09-24 15:58:41 -06:00
Markus Pilman 4c25214085 Add ability to run tests on fdb in ctest 2020-09-24 15:43:05 -06:00
Jon Fu a78da8b3ce Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version 2020-09-24 14:40:01 -04:00
Jon Fu 9fee52ba34 adjust test to include snapshot restore and ibackup together 2020-09-24 12:09:49 -04:00
Jon Fu 7553daba20 change waitVersion to waitForBackup 2020-09-23 16:13:30 -04:00
Jon Fu 69580593dd Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version 2020-09-23 15:35:05 -04:00
Jon Fu 285e2594ef adjusted delay and timing of version gate 2020-09-23 14:28:47 -04:00
Jon Fu 7780c24cbe Attempt to use version instead of test duration to have backup capture all changes 2020-09-21 14:45:29 -04:00
Jon Fu 9b7d75b6dd WIP 2020-09-21 13:41:35 -04:00
Jingyu Zhou ea27e4bd9c
Merge pull request #3772 from yliucode/rename
Rename master proxy as commit proxy
2020-09-16 20:06:50 -07:00
Young Liu cc5bc16bd8 Rename more places from proxy to commit proxy 2020-09-15 22:29:49 -07:00
Jon Fu 37d77ecb64 WIP of adding tests 2020-09-15 13:31:06 -04:00
Young Liu 35bef73a1c Rename proxy to commit proxy 2020-09-10 17:44:15 -07:00
Trevor Clinkenbeard 732a457ba4
Merge pull request #3720 from sfc-gh-xwang/mako
update mako and WriteTagThrottling workload so as to trigger tag throttling event
2020-09-10 15:21:00 -07:00
Jon Fu 0eb7092faa Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only 2020-09-08 12:53:29 -04:00
Xin Dong 4bab3f56df Disable readhot detection workload for now. 2020-09-04 10:01:58 -07:00
Young Liu 87693cae81 merge master branch and resolve conflicts 2020-09-02 13:44:33 -07:00
Xiaoxi Wang f930f9bbb6 update toml test spec 2020-09-02 05:25:40 +00:00
Jon Fu b9baa996e3 Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only 2020-09-01 14:38:02 -04:00
Evan Tschannen 7eeaf55f2b fixed conflicts with tests 2020-08-31 21:18:49 -07:00
Evan Tschannen 12edadd059 Merge branch 'release-6.3'
# Conflicts:
#	CMakeLists.txt
#	fdbclient/Knobs.cpp
#	fdbclient/MasterProxyInterface.h
#	fdbrpc/simulator.h
#	fdbserver/MasterProxyServer.actor.cpp
#	tests/fast/CycleAndLock.txt
#	tests/fast/TxnStateStoreCycleTest.txt
#	tests/fast/VersionStamp.txt
#	tests/slow/ParallelRestoreOldBackupApiCorrectnessAtomicRestore.txt
#	tests/slow/ParallelRestoreOldBackupCorrectnessCycle.txt
#	versions.target
2020-08-31 19:33:34 -07:00
Evan Tschannen 29eec30183 Merge branch 'release-6.2' into release-6.3
# Conflicts:
#	CMakeLists.txt
#	build/Dockerfile
#	build/Dockerfile.devel
#	documentation/sphinx/source/downloads.rst
#	fdbserver/Knobs.cpp
#	fdbserver/LogSystem.h
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/TagPartitionedLogSystem.actor.cpp
#	fdbserver/WaitFailure.actor.cpp
#	fdbserver/fdbserver.vcxproj
#	fdbserver/fdbserver.vcxproj.filters
#	packaging/msi/FDBInstaller.wxs
2020-08-31 01:10:29 -07:00
Jon Fu 4831f11e2a Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only 2020-08-28 12:47:19 -04:00
Jon Fu 0270ee13c8 change targetversion from maxlogend to contiguouslogend. also adjusted test workload and specs 2020-08-28 12:46:34 -04:00
Meng Xu ca486fdcd4 FastRestoreOldBackupTest:Revert workload time to 30s 2020-08-27 09:31:57 -07:00
Meng Xu 3d2b18b663 FastRestore:AtomicRestore:Add resetDBTimeout option 2020-08-26 10:21:17 -07:00
Meng Xu a8bd628216 FastRestoreAtomicRestoreTest:Increase timeout from 2100 to 36000 2020-08-26 09:48:52 -07:00
Meng Xu 1b7a0d9b1d FastRestoreTest:Increase cycle test duration from 40 to 60s 2020-08-25 22:47:39 -07:00
Meng Xu 57584f41a0 FastRestoreOldBackup:Change backup latency from 60 to 40s 2020-08-25 10:42:28 -07:00
Meng Xu 23c8d0154b FastRestoreOldBackupTest:Increase test duragion
Add comment on Rollback test as well
2020-08-25 09:14:37 -07:00
Young Liu 63b3612ad5 Merge master branch and resolve conflicts 2020-08-24 16:42:31 -07:00
David Youngworth e1b7dd0c7d Merge remote-tracking branch 'upstream/release-6.3' into dyoungworth/fixMerge1 2020-08-22 12:25:19 -07:00
Andrew Noyes 3737b8dd7b Add LockDatabaseFrequently to TxnStateStoreCycleTest 2020-08-20 18:45:42 +00:00
Andrew Noyes bc5da1f6d7 Add LockDatabaseFrequently to VersionStamp test 2020-08-20 02:33:06 +00:00
Andrew Noyes fbc97a12b8 Add LockDatabaseFrequently workload 2020-08-19 23:17:38 +00:00
Jon Fu ae999aa118 Merge branch 'master' of https://github.com/apple/foundationdb into jfu-incremental-backup-only 2020-08-19 16:36:47 -04:00
Jon Fu 35aa1034cd added new test spec and workload to verify correctness of incremental backup and restore 2020-08-19 13:45:51 -04:00
Jingyu Zhou 2295bb223a Bump to 5.0.0 as 4.6.4 is using version larger than hasMultiGenerationTLog() 2020-08-16 09:29:14 -07:00
Jingyu Zhou 1a59926d75 Limit Storefront and Cycle restart tests to 4.6.0 and up
The assertion in DBCoreState.h insists on hasMultiGenerationTLog(), which is
only available on 4.6.0 and up versions.
2020-08-16 09:29:06 -07:00
Young Liu 79ce16650d merge master branch 2020-08-11 19:22:10 -07:00
Markus Pilman acb151864b minor bug fixes 2020-08-06 16:56:38 -06:00
Young Liu d6a23a4d6b Resolve comments to make GRV proxy a separate process class 2020-08-06 00:01:57 -07:00
Evan Tschannen 0674dba085
Merge pull request #3574 from etschannen/master
Merge 6.3 into Master
2020-07-31 20:06:15 -07:00
Jingyu Zhou 66f6b89ef7 Bump to 5.0.0 as 4.6.4 is using version larger than hasMultiGenerationTLog() 2020-07-31 14:53:16 -07:00
Jingyu Zhou 4254413cc0 Limit Storefront and Cycle restart tests to 4.6.0 and up
The assertion in DBCoreState.h insists on hasMultiGenerationTLog(), which is
only available on 4.6.0 and up versions.
2020-07-31 14:33:57 -07:00
Young Liu 86148f1277 Merge branch 'master' into grv-proxy 2020-07-29 11:14:51 -07:00
Young Liu f7b76a92af pass joshua 2020-07-29 07:26:55 -07:00
Evan Tschannen 3623b28df5 fixed merge conflict 2020-07-29 00:36:12 -07:00
Evan Tschannen a49cb41de7 Merge branch 'release-6.3'
# Conflicts:
#	CMakeLists.txt
#	cmake/ConfigureCompiler.cmake
#	fdbserver/Knobs.cpp
#	fdbserver/StorageCache.actor.cpp
#	fdbserver/storageserver.actor.cpp
#	flow/ThreadHelper.actor.h
#	flow/serialize.h
#	tests/CMakeLists.txt
2020-07-29 00:31:55 -07:00
Meng Xu 2b8aa296bb
Merge pull request #3482 from sfc-gh-tclinkenbeard/support-downgrades
Support and test downgrades
2020-07-28 17:00:54 -07:00
Young Liu b2df089f58 make storefront test pass for now 2020-07-26 10:23:29 -07:00
Xiaoxi Wang 272ef87933 toml file 2020-07-22 06:08:47 +00:00
sfc-gh-tclinkenbeard a1d3496d7d Update downgrade tests to use 6.3.5 instead of 6.3.3 2020-07-20 18:47:43 -07:00
Xiaoxi Wang 893898818c merge master 2020-07-20 23:38:05 +00:00
Xiaoxi Wang bce0c2758e add fastSuccess 2020-07-20 23:27:20 +00:00
Alex Miller 878254497a Merge remote-tracking branch 'upstream/master' into toml-testspec 2020-07-19 22:18:31 -07:00
Xiaoxi Wang f3ee60b10b slight change 2020-07-20 03:17:46 +00:00
Xiaoxi Wang 1c483d3423 rewrite Throttling.actor.cpp; fix '/' bug in HealthMetricsApi 2020-07-20 01:20:14 +00:00
Meng Xu dd85a1ec04 Fix LowLatencyWithFailures.txt
connectionFailuresDisableDuration and minimumReplication global variable should come before testName
2020-07-15 14:17:55 -07:00
Meng Xu 8ae0d9b73d Resolve merge conflict 2020-07-13 10:21:53 -07:00
Meng Xu ef8c1060a2 Merge branch 'master' into mengxu/tmp-merge-6.3 2020-07-13 10:15:56 -07:00
sfc-gh-tclinkenbeard d0189ad0d4 Relax commit latency requirement for LowLatency workload 2020-07-12 20:01:57 -07:00
Alex Miller 2841efe938 Rewrite most .txt tests into (pretty) .toml files.
This includes build/txt-to-toml.py which did the rewrites, and
can be used to rewrite other no-in-tree test spec files to toml.

I didn't touch status or restarting tests yet.  Restarting will be handled
later.  It turns out that I don't understand how status tests work.
2020-07-12 14:47:40 -07:00
Meng Xu 7bbdfeca05
Merge pull request #3474 from jzhou77/master
Use KeyRangeMap for splitMutation
2020-07-09 21:52:12 -07:00
sfc-gh-tclinkenbeard 10a4b8e321 Make Downgrade test rare 2020-07-09 17:52:41 -07:00
sfc-gh-tclinkenbeard 8a5fb5ec15 Move to_6.3.0 restarting test to to_6.3.3 2020-07-09 17:24:43 -07:00
sfc-gh-tclinkenbeard 949a17359a Added to_6.3.0 downgrade test to test harness 2020-07-09 14:29:43 -07:00
sfc-gh-tclinkenbeard 373b5ffb4f Added forward compatibility and Downgrade workload 2020-07-09 14:28:35 -07:00
Xiaoxi Wang 2a848edb41 Merge remote-tracking branch 'upstream/master' 2020-07-09 18:10:38 +00:00
Xiaoxi Wang c40c4693b4 better correctness criteria 2020-07-09 18:10:12 +00:00
Meng Xu 1dead7c199
Merge pull request #3440 from sfc-gh-xwang/master
add HealthMetricsWorkload and WriteTagThrottlingWorkload
2020-07-09 10:04:46 -07:00
Jingyu Zhou a5af214861 Use KeyRangeMap for splitMutation
This simplifies code by reuse KeyRangeMap class.
2020-07-09 09:59:37 -07:00
Meng Xu d61206e126
Merge pull request #3453 from thisismiller/restrict-testspec
Make testspec more restrictive and correctly "scoped"
2020-07-08 11:43:37 -07:00
Jingyu Zhou e78cc9ee4b Use KeyRangeMap for splitMutation
This simplifies code by reuse KeyRangeMap class.
2020-07-08 09:53:34 -07:00
Xiaoxi Wang 627075e0ef 1. add test parameters; 2. change ContinuousSample initialization 3. add&change metrics 2020-07-06 18:18:15 +00:00
Alex Miller 17570b5b10 Make the testspec more restrictive in terms of what can be set where.
Testspec is currently very permissive in very misleading ways.  In particular,
the tester parser itself will swallow K=V settings and apply them at the test
level, which breaks how a person would expect the scoping to work.  Other
settings apply to the entire simulation run globally, but appear to be workload
specific.  Even further, others affect simulation cluster creation or test
harness behavior, but can again be set anywhere in a testspec.

This changes testspec parsing to error if a setting that applies globally is
anywhere but the top of the file, or if a setting that applies test-wide is
applied to a workload instead of a test.
2020-07-06 02:03:30 -07:00
Xiaoxi Wang 121465b051 change metrics
fix latency sum bug
2020-07-03 21:49:44 +00:00
Xiaoxi Wang 98b3ef69aa 1.change metrics; 2.change the way to generate key (avoid to much confict) 2020-07-03 00:20:39 +00:00
Xiaoxi Wang c1face27f1 fix dangling pointer bugs 2020-07-02 18:35:39 +00:00
Alex Miller c76e0cfe04 Add a ReadAfterWrite workload, to measure TLog->SS propagation delay. 2020-07-01 02:17:43 -07:00
Xiaoxi Wang 6ebd3c8083 1. add range clear operation to workload
2. add tag logic to WriteTagThrottling
2020-07-01 06:35:14 +00:00
Xiaoxi Wang ad6904413c Merge branch 'master' of https://github.com/apple/foundationdb 2020-07-01 04:58:02 +00:00
Xiaoxi Wang dc568cad21 add HealthMetricsWorkload and WriteTagThrottlingWorkload to prepare for new throttling feature 2020-07-01 04:56:21 +00:00
Meng Xu 22f7f804b8 Merge branch 'release-6.3' into mengxu/merge-6.3-PR 2020-06-28 11:19:39 -07:00
Meng Xu 90861ead6a Reenable all tests in BackupAndParallelRestoreWithAtomicOp 2020-06-23 08:29:31 -07:00
Meng Xu b122575dda BackupAndParallelRestoreWithAtomicOp:Turn on debug options 2020-06-22 16:53:43 -07:00
Andrew Noyes 6e18b6454a Remove obsolete file 2020-06-16 10:13:57 -07:00
Meng Xu 96206a8032
Merge pull request #3368 from apple/release-6.3
Merge Release 6.3 to master
2020-06-15 20:15:22 -07:00
Meng Xu 39c50798b8
Merge pull request #3341 from sfc-gh-clin/fix-rpc-calls-in-special-key-space
Fix fetchShardMetricsList_impl and add read cache in special key space
2020-06-15 16:12:38 -07:00
Daniel Smith acbfe2e4c9
Revert "Revert "Initial RocksDB"" 2020-06-15 12:45:36 -04:00
Chaoguang Lin 980bee1d13 Fix fetchShardMetricsList_impl and add read cache in special key space 2020-06-12 10:12:44 -07:00
Jingyu Zhou 9cd1614c82
Revert "Initial RocksDB" 2020-06-11 15:29:46 -07:00
Daniel Smith a4dbb5dd01 Merge branch 'trace-batch-thread-hostile' into rocksdb-6.3 2020-06-11 15:53:57 +00:00
sfc-gh-ngoyal 693d9e8b89
Merge branch 'master' into fdb_cache_wo_allocator 2020-06-09 15:09:58 -07:00
Meng Xu cf1ae52751
Merge pull request #3281 from apple/release-6.3
Merge Release 6.3 into master
2020-06-03 10:55:37 -07:00
negoyal cf13e00a8f Merge remote-tracking branch 'origin/release-6.3' into fdb_cache_wo_allocator 2020-06-01 17:38:31 -07:00
A.J. Beamon d128252e90 Merge release-6.3 into master 2020-05-22 09:25:32 -07:00
Daniel Smith 5d361fe532 Copy/paste rebase onto 6.3 2020-05-22 15:02:51 +00:00
A.J. Beamon 56e14a25fe Normal correctness package can be built when USE_VALGRIND is on. Correctness and valgrind now stage their files in separate directories. Add CMakeCache.txt to testing packages. 2020-05-21 13:35:54 -07:00
Chaoguang Lin 6ce574f5ad Merge remote-tracking branch 'upstream/release-6.3' into add-data-distribution-metrics 2020-05-17 23:36:52 -07:00
tclinken 5632af3b4d Removed inaccurate warning 2020-05-16 20:20:11 -07:00
tclinken 25390f0968 Remove SimpleExternalTest.txt from fdb_test_files even if UBSAN is enabled 2020-05-13 22:46:07 -07:00
A.J. Beamon 02307ba7b6 Merge branch 'master' into transaction-tagging
# Conflicts:
#	fdbclient/DatabaseContext.h
2020-05-09 07:50:29 -07:00
Chaoguang Lin ef724bf939 Merge remote-tracking branch 'upstream/master' into add-data-distribution-metrics 2020-05-08 18:39:28 -07:00
negoyal 749fcd13b0 Merge branch 'master' into fdb_cache_wo_allocator 2020-05-08 16:23:29 -07:00
sramamoorthy 13ff1b3b20 Revert "Exclude Snap related tests from correctness test temporily"
This reverts commit f95bbc0ffa.
2020-05-07 14:39:13 -07:00
A.J. Beamon b1055a8501 Merge branch 'master' into transaction-tagging 2020-05-05 16:03:39 -07:00
Evan Tschannen f329164fb4
Merge pull request #2532 from dongxinEric/feature/hot-read-key-detection-part-2
Feature/hot read key detection part 2
2020-05-05 14:33:34 -07:00
Alex Miller 378951360d
Merge pull request #3086 from alexmiller-apple/ctest-use-crash
Make ctest use --crash when running simulation tests.
2020-05-05 12:49:21 -07:00
Alex Miller f040694bf0 Make ctest use --crash when running simulation tests.
So that tests with ASSERTion failures don't cause CI to run slow and
produce massive logs.  There's also rarely a reason to continue through
assertion failures.
2020-05-05 03:11:09 -07:00
negoyal dd033736ed Merge branch 'master' into fdb_cache_subfeature2 2020-05-04 17:29:43 -07:00
A.J. Beamon 80a235aa80 Add some correctness tests 2020-05-04 10:15:18 -07:00
Xin Dong 1927f15898 Now the ReadHotDetection tests can be run reliably. Added it to nightly bundle. 2020-04-28 13:26:02 -07:00
Markus Pilman 50ad4a33fe Added possibility to include and exclude tests
Description

Testing
2020-04-28 16:19:04 +00:00
Xin Dong 7dd7406c59
Merge branch 'master' into feature/hot-read-key-detection-part-2 2020-04-16 14:54:05 -07:00
negoyal b85dc16c6d Merge branch 'master' into fdb_cache_subfeature2 2020-04-14 17:07:41 -07:00
chaoguang 65620b00f3 Merge remote-tracking branch 'upstream/master' into private-keyspace-framework 2020-04-13 14:21:07 -07:00
Meng Xu f95bbc0ffa Exclude Snap related tests from correctness test temporily
Those tests fail with high chance in nightly test.
2020-04-10 10:01:07 -07:00
Markus Pilman 2a856b23d3 Added test files and updated vsproj files 2020-04-06 09:53:18 -07:00
negoyal a0c8946f31 Merge branch 'master' into fdb_cache_subfeature2 2020-04-02 12:27:04 -07:00
Meng Xu 38d7f16de0 FastRestore:Add new tests to ctests 2020-04-01 21:34:26 -07:00
Meng Xu 16898408ae FastRestore:Rename tests for new backup by adding NewBackup keyword 2020-04-01 21:31:54 -07:00
Meng Xu 1eea388278 Add unit test for splitMutation test file
Comment out debug trace as well.
2020-04-01 21:27:18 -07:00
Meng Xu 321b1b6ee7 Add RunRestoreWorkerWorkload into Parallel Restore WriteDuringReadAtomicRestore tests 2020-03-31 18:48:29 -07:00
Meng Xu a1d2779f04 Add ParallelRestoreWriteDuringReadAtomicRestore.txt
Test for fast restore with new backup.
2020-03-31 18:25:17 -07:00