Commit Graph

808 Commits

Author SHA1 Message Date
Vaidas Gasiunas 37bc41abbb Merge remote-tracking branch 'apple/master' into multi-version-client-2 2021-10-26 18:51:43 +02:00
Josh Slocum 58e5ffbd31 Disabling frequently failing tests until they can be fixed 2021-10-26 09:32:01 -07:00
Josh Slocum 0ff8ddc2b6 Merge branch 'master' into blob_full_clean 2021-10-25 13:38:48 -05:00
Evan Tschannen 6f7558b8ea Merge branch 'master' of https://github.com/apple/foundationdb into feature-range-feed
# Conflicts:
#	tests/CMakeLists.txt
2021-10-24 21:06:33 -07:00
Suraj Gupta 09df358b77 Re-ignore tests. 2021-10-14 19:23:12 -04:00
He Liu dbfeb06c97 Reproduced user data loss incident, and tested the improved exclude tool
can fix the system metadata.
2021-10-14 14:08:39 -07:00
Josh Slocum 5f0ec0612a Merge branch 'feature-range-feed' into blob_full 2021-10-13 15:44:35 -05:00
Suraj Gupta 180e806086 Add new test to cmakelists 2021-10-13 15:10:52 -04:00
Suraj Gupta cfb8368da6 Address PR comments. 2021-10-13 14:56:17 -04:00
Suraj Gupta 266a5b06fa Fix infinite loop. 2021-10-13 14:40:26 -04:00
negoyal f913dfed97 Merge branch 'master' into bit-flipping-workload 2021-10-11 16:34:57 -07:00
Evan Tschannen 5c642f706e Merge branch 'master' of https://github.com/apple/foundationdb into feature-range-feed
# Conflicts:
#	fdbcli/fdbcli.actor.cpp
2021-10-09 19:34:16 -07:00
Vaidas Gasiunas bd838217ba MVC2.0: Testing client lib operations with random file sizes
- Adding test parameters to control file size range
- Disabling AIO as it does not support non-page-aligned reads and writes
- Fixing bugs for the cases of an empty file and an incomplete last chunk
- Use hexadecimal representation for checksum in JSON and document keys
2021-10-07 17:23:17 +02:00
Vaidas Gasiunas cda0a5f931 Operation to upload client library binary in to system keyspace 2021-10-06 18:01:46 +02:00
A.J. Beamon c82d820bfd Fixes to new disconnected tests; add a version that doesn't use MVC 2021-09-29 13:16:17 -06:00
A.J. Beamon de863d170d Add some tests for timeout behavior with disconnected clusters 2021-09-29 13:16:17 -06:00
Josh Slocum 77b0458f9f reducing volume for large workload since there are multiple testers 2021-09-25 11:25:12 -05:00
Xiaoxi Wang 1730d75f73 change configure test
add store type check
add test file
2021-09-21 18:11:04 -07:00
Evan Tschannen 5d2c86d87c rename test file 2021-09-20 13:58:05 -07:00
Evan Tschannen 2da7732637 added a new workload to test streaming reads 2021-09-20 13:58:05 -07:00
Josh Slocum c780b8ae69 adding granule tests to test suite 2021-09-17 10:17:05 -05:00
Mohamed Oulmahdi e93f6e323a Fix test paths for on Windows 2021-09-15 16:30:58 -06:00
negoyal 078cc7ee55 Merge branch 'master' into bit-flipping-workload 2021-09-10 10:26:21 -07:00
Josh Slocum c2d1d1704f Merge branch 'feature-range-feed' into blob_full 2021-09-10 11:21:52 -05:00
Evan Tschannen ac5b580e2d Merge branch 'master' into feature-range-feed
# Conflicts:
#	fdbcli/fdbcli.actor.cpp
#	fdbclient/StorageServerInterface.cpp
#	fdbclient/StorageServerInterface.h
#	fdbserver/ApplyMetadataMutation.cpp
#	fdbserver/TLogServer.actor.cpp
#	flow/error_definitions.h
2021-09-09 23:13:22 -07:00
negoyal a48148fdb2 Tweak the chaos toml file. 2021-09-08 22:53:52 -07:00
negoyal 7729a282ce Misc fixes and updated test toml file. 2021-09-08 14:31:09 -07:00
Josh Slocum eb76343dfb Added blob granule reassignment and splitting 2021-09-08 14:09:14 -05:00
Evan Tschannen 9fefd59076 Fixed a number of bugs, change feeds are correctness clean with the current workload 2021-09-05 18:17:23 -07:00
Evan Tschannen 367c7cda92 fixed problems with the change feed workload 2021-09-03 15:14:28 -07:00
negoyal a8baeb75d0 Misc fixes. 2021-09-03 15:03:12 -07:00
Evan Tschannen b02e8d99c6 added a workload to test change feeds 2021-09-03 14:19:27 -07:00
Chaoguang Lin 82e1e850c2 Add syntax until_*.*.* in restarting test to specify upper bound of binary version 2021-09-02 14:07:15 -07:00
A.J. Beamon ee357881b5 Add the new test to cmake 2021-08-31 15:19:52 -07:00
A.J. Beamon f78a68735a Add a specific unit test file for use by tooling. 2021-08-31 15:06:13 -07:00
negoyal 3b34423248 Merge branch 'master' into bit-flipping-workload 2021-08-31 12:14:51 -07:00
Jon Fu 25b8e2e152 Exclude redwood in from_5.0.0 tests 2021-08-30 17:13:49 -04:00
Jon Fu 3f77c72821 Exclude redwood from part 1 of restarting tests that are from versions < 6.3 2021-08-30 16:49:49 -04:00
sfc-gh-tclinkenbeard 8f97d66b44 Increase minimum downgrade version 2021-08-30 11:14:59 -07:00
sfc-gh-tclinkenbeard 6ecc38d22a Strengthen ConfigIncrement.toml test 2021-08-27 15:18:32 -07:00
Josh Slocum 8d49c98a41 Added simulation workload for blob granules and fixed some bugs 2021-08-26 13:48:05 -05:00
sfc-gh-tclinkenbeard 288933bdf6 Add MachineAttrition to ConfigIncrement workload 2021-08-24 11:30:41 -07:00
sfc-gh-tclinkenbeard a047782db2 Merge remote-tracking branch 'origin/master' into paxos-config-db 2021-08-24 11:08:20 -07:00
sfc-gh-tclinkenbeard 9e7ed1f18c Randomize configuration database type for ConfigIncrement test 2021-08-24 11:08:06 -07:00
Steve Atherton ebdb9064ff
Merge pull request #5359 from RenxuanW/mlr
Check in the prototype of MutationLogReader.
2021-08-19 21:11:10 -07:00
sfc-gh-tclinkenbeard 658233d0e0 Merge remote-tracking branch 'origin/master' into paxos-config-db 2021-08-19 16:18:59 -07:00
Renxuan Wang 454beeb1cf Delete toml for unit test. 2021-08-18 15:01:45 -07:00
Renxuan Wang 6e89dc3da0 Check in the prototype of MutationLogReader. 2021-08-18 14:59:50 -07:00
Mohamed Oulmahdi bce42671ff Add IThreadPool test to cmake 2021-08-18 16:05:12 +02:00
sfc-gh-tclinkenbeard 0bacc310ef Reenable consumer in config broadcaster 2021-08-17 12:09:12 -07:00
sfc-gh-tclinkenbeard 47b4c9a4f7 Temporarily disable ConfigIncrement test 2021-08-16 10:50:14 -07:00
sfc-gh-tclinkenbeard 3418c20867 Merge remote-tracking branch 'origin/master' into paxos-config-db 2021-08-16 10:49:47 -07:00
sfc-gh-tclinkenbeard d8bdc972ba Only test simple configuration database in ConfigIncrement.toml
There are still some issues with the Paxos implementation that are
causing test failures at the moment.
2021-08-10 11:18:56 -07:00
Josh Slocum 921a2cfca1 Merge branch 'feature-range-feed' into blob_full 2021-08-10 11:25:48 -05:00
Josh Slocum 247602753d Blob worker handles multiple ranges now 2021-08-10 11:19:43 -05:00
helium 751fc59d54 revert unintended changes 2021-08-09 16:29:57 -07:00
helium 15d050ece5 Added unit test, and bug fixes. 2021-08-09 16:26:29 -07:00
helium 9a9346afaf Added unit test. 2021-08-09 16:21:43 -07:00
sfc-gh-tclinkenbeard c126e6239b Weaken ConfigIncrement.toml test
This test is not yet stable, so simplify the test in order to make
debugging easier.
2021-08-09 10:18:18 -07:00
sfc-gh-tclinkenbeard f6b6e11d6a Support randomizing configuration database type in simulation 2021-08-09 10:04:35 -07:00
sfc-gh-tclinkenbeard cdbcb69d86 Add configuration database type to ISimulator 2021-08-09 10:04:35 -07:00
sfc-gh-tclinkenbeard 6524dd1567 Add random sleep to ConfigIncrement workload 2021-08-09 10:04:35 -07:00
sfc-gh-tclinkenbeard 7deb339a0c Added ConfigIncrement.toml test 2021-08-09 10:04:35 -07:00
Josh Slocum e5b0cf20aa Reader can read blob worker interface and mapping from db, read files, apply mutations, and return result 2021-08-06 11:02:05 -05:00
negoyal 9e7197faba Bunch of changes based on review comments and discussions. 2021-07-30 01:32:43 -07:00
negoyal 40b4f3b2f1 Merge branch 'master' into bit-flipping-workload 2021-07-28 18:06:07 -07:00
negoyal 050c218502 New Disk Delay Logic and ChaosMetrics. 2021-07-28 16:03:37 -07:00
Markus Pilman 91e5498357 disable simulation in ctest by default 2021-07-27 11:17:55 -06:00
Trevor Clinkenbeard 48d4ea6d57
Merge pull request #5231 from sfc-gh-tclinkenbeard/availability-improvements
Throw `failed_to_progress` error when a role fails to make progress
2021-07-26 15:55:14 -07:00
sfc-gh-tclinkenbeard 1dc9839e49 Increase max latency for LowLatencySingleClog test 2021-07-19 22:34:27 -07:00
negoyal 596ca92e2f Add missing files and rename some. 2021-07-19 11:13:57 -07:00
negoyal f950fe9f9d Chaos workload to randomly flip bits during SS writes. 2021-07-18 17:35:05 -07:00
Steve Atherton 09a8561606 Merge branch 'master' of github.com:apple/foundationdb into redwood-io-priority
# Conflicts:
#	fdbserver/IPager.h
#	fdbserver/VersionedBTree.actor.cpp
2021-07-18 01:49:36 -07:00
Evan Tschannen b7b845dab8
Revert "RocksDB in simulation" 2021-07-15 16:41:33 -07:00
Chaoguang Lin c8e18f99f0
Merge pull request #5185 from sfc-gh-clin/extend-fdbclient-test-for-multiple-processes
Extend cmake fdbclient_test for multiple processes
2021-07-15 14:34:04 -07:00
Daniel Smith 4c1288faa7
Merge pull request #5144 from Daniel-B-Smith/rocksdb-in-simulation
RocksDB in simulation
2021-07-15 16:00:09 -04:00
Chaoguang Lin 3552080266 Update some comments of the change 2021-07-15 16:38:04 +00:00
Chaoguang Lin a3ae0c26ca Add comments, fix foundationdb.conf template 2021-07-14 22:36:17 +00:00
Chaoguang Lin 063de7d7fc Remove unnecessay change, fix bug 2021-07-14 21:26:54 +00:00
Chaoguang Lin c6a01d3976 Set process_number=1 for TempCluster 2021-07-14 21:21:52 +00:00
Chaoguang Lin b5629bc014 Add default value for process_number in the constructor of TempCluster 2021-07-14 20:58:20 +00:00
Chaoguang Lin 41a9470058 Add comments, remove debugging info 2021-07-14 20:24:16 +00:00
Chaoguang Lin 1e3d3811cc Merge branch 'master' of github.com:apple/foundationdb into extend-fdbclient-test-for-multiple-processes 2021-07-14 20:20:39 +00:00
Chaoguang Lin 368657623a Extend add_fdbclient_test to support multiple processes' cluster 2021-07-14 20:17:12 +00:00
sfc-gh-tclinkenbeard 475abe301c Merge remote-tracking branch 'origin/master' into fix-ub 2021-07-14 10:47:02 -07:00
Daniel Smith 6e0bfba745 Don't use the RocksDB engine with snapshot tests 2021-07-13 12:25:11 -04:00
Russell Sears c42815f15f
Merge pull request #5127 from vishesh/cherrypick
Making it possible to run a multiple-cluster Java integration test (cherry-pick of #4456 from 6.3)
2021-07-13 09:14:20 -07:00
negoyal 1b8b22decc Wrapper class to avoid adding overhead to all async disk calls 2021-07-12 17:51:01 -07:00
sfc-gh-tclinkenbeard 4ce6b8eea1 Disable LowLatencySingleClog test 2021-07-12 17:18:29 -07:00
sfc-gh-tclinkenbeard fbc4f47882 Add LowLatencySingleClog.toml test 2021-07-10 17:30:20 -07:00
Scott Fines d1db0d4013 Making it possible to run a multiple-cluster Java integration test 2021-07-07 10:15:18 -07:00
negoyal 957eceb14c And the test file. 2021-07-01 15:01:13 -07:00
negoyal df39c5a44e Implement Disk Throttling Chaos workload. 2021-06-30 17:05:04 -07:00
Zhe Wu 865367fb72 Add updateWorkerHealth interface in cluster controller 2021-06-24 19:42:28 -07:00
Andrew Noyes c9b06839fc Halt on error in ubsan for ctest tests 2021-06-23 09:25:51 -07:00
Trevor Clinkenbeard 481b785953
Merge pull request #5020 from dlambrig/issue4984
Do not allow descriptor to change on upgrade tests
2021-06-21 09:13:38 -07:00
Dan Lambright 68b58b71db Do not allow descriptor to change on upgrade tests 2021-06-21 11:54:44 -04:00
Zhe Wu e3c9d9f6a0
Merge pull request #4987 from halfprice/zhewu/worker-health-monitor
Create health monitor in FDB workers to monitor peer network condition
2021-06-17 16:58:24 -07:00
Daniel Smith f9edb3d870
Merge pull request #4983 from Daniel-B-Smith/rollforward-test-nonsim
Roll forward: Add support for running non-simulation tests on Joshua
2021-06-16 18:49:00 -04:00
Zhe Wu 4e3e2b0392 Create health monitor in FDB workers to monitor network condition. This change is only inside the worker. 2021-06-16 14:50:44 -07:00
Xiaoxi Wang 8f3e8ecf10 add injected fault check 2021-06-15 21:47:16 +00:00
Daniel Smith 44cba555eb Don't fail on missing simfdb dir 2021-06-15 14:15:02 -04:00
Daniel Smith 6eb383cfc3 Run noSim test as a unit test 2021-06-15 14:15:02 -04:00
Daniel Smith efdda3cd0e Revert "Revert "Add support for running non-simulation tests on Joshua"" 2021-06-15 14:15:02 -04:00
Daniel Smith 549cf0512b
Revert "Add support for running non-simulation tests on Joshua" 2021-06-14 19:23:56 -04:00
Daniel Smith ef2a2cd1a5 Actually add test file 2021-06-14 15:00:45 -04:00
Daniel Smith 8af0affeff Add support for running non-simulation tests on Joshua 2021-06-14 15:00:45 -04:00
Josh Slocum ad90b03012
Merge pull request #4949 from sfc-gh-jslocum/tss_downgrade
TSS downgrade changes
2021-06-10 14:06:38 -07:00
Josh Slocum 59726545a4 TSS downgrade changes 2021-06-10 19:30:45 +00:00
Andrew Noyes eebba211ef 150 was too short and we were seeing false positives 2021-06-10 11:14:38 -07:00
A.J. Beamon 6f5ae9d76a
Merge pull request #4882 from sfc-gh-ajbeamon/restarting-test-increase-6.2-version
Require a minimum of 6.2.33 for 6.2 snapshot restarting tests
2021-06-01 09:42:07 -07:00
A.J. Beamon f28dae7c70 Require a minimum of 6.2.33 for 6.2 snapshot restarting tests to avoid a bug in prior versions 2021-05-28 12:43:30 -07:00
Josh Slocum ce82c9653e Testing Storage Server implementation 2021-05-25 20:28:50 +00:00
Markus Pilman 64608fe86b allow simulation properties to be overwritten 2021-05-20 13:48:41 -06:00
Lukas Joswiak 6499fa178e
Merge pull request #4802 from sfc-gh-ljoswiak/revert/actor-lineage
Revert "Merge pull request #4136 from sfc-gh-mpilman/features/actor-l…
2021-05-11 18:50:42 -07:00
Chaoguang Lin ed3415c93e Guard the added unit test by NOT OPEN_FOR_IDE 2021-05-11 12:21:09 -07:00
Chaoguang Lin 804354f9b2 Merge branch 'master' of github.com:apple/foundationdb into refactor-fdbcli 2021-05-11 12:14:59 -07:00
Lukas Joswiak 4ea760b2a9 Revert "Merge pull request #4136 from sfc-gh-mpilman/features/actor-lineage"
This reverts commit da41534618, reversing
changes made to e6300905d6.
2021-05-10 20:26:12 -07:00
Edwin Zhang 3d9619790d Fix OPEN_FOR_IDE option for cmake 2021-05-07 17:54:59 -04:00
Chaoguang Lin 24247057ff Add two safeThreadFuture unit tests into ctest 2021-05-06 16:34:13 -07:00
Lukas Joswiak 8dcd779fc4
Merge branch 'master' into features/actor-lineage 2021-05-02 14:11:42 -07:00
A.J. Beamon 8eb78fd317
Merge pull request #4714 from sfc-gh-anoyes/anoyes/more-thread-safety-ctest
Add /fdbclient/multiversionclient/ to ctest, and fix thread safety
2021-04-28 08:54:16 -07:00
Markus Pilman 4fab2ecd30 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-28 09:20:54 -06:00
Andrew Noyes 6fc59379d8 Add /fdbclient/multiversionclient/ to ctest, and fix thread safety 2021-04-23 21:17:41 +00:00
Josh Slocum 4b5bca6761 Minor Redwood comparison optimizations 2021-04-23 18:49:43 +00:00
Russell Sears 77af97c7a3
Merge pull request #4622 from vishesh/task/fix-loopback-cluster
loopback_cluster: Find `fdbcli` from `$BUILD` path
2021-04-22 10:05:00 -07:00
Steve Atherton 9ee2cd7bcb Renamed prefixesAllowed again for clarity. 2021-04-20 11:54:40 -07:00
Steve Atherton 3c7dc1a59e Backup correctness workload bug fix. Sometimes the restore target ranges are empty, which causes a test timeout. Renamed some variables for clarity. 2021-04-19 21:36:47 -07:00
Markus Pilman 7307750e5e Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-19 11:29:52 -06:00
Markus Pilman a445e09c2d
Merge pull request #4617 from sfc-gh-satherton/unit-test-params
Added UnitTest parameters concept and ability to run unit tests directly from command line, with parameters
2021-04-15 14:59:15 -06:00
Steve Atherton 8616575c21 Merge commit 'd51f94f16ee903aa249ddaac0047c88cafac1e89' into unit-test-params 2021-04-14 18:23:00 -07:00
Jon Fu f6f225ccae Merge branch 'master' of github.com:apple/foundationdb into jfu-test-conf-options 2021-04-14 14:21:23 -04:00
Steve Atherton 6bcd997bb9 Merge commit '83cc3d3af058fdcb23a8681e0bf28cac7de3e61e' into unit-test-params 2021-04-14 10:04:55 -07:00
Markus Pilman 1d362d8869 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-14 09:55:04 -06:00
Steve Atherton 1c5013f6ec Removed btree cleanup parameter override. 2021-04-13 20:19:25 -07:00
Andrew Noyes eb4c80db39 Respect the version constraints for restart tests in ctest 2021-04-12 23:15:17 +00:00
Jon Fu 57d24263ef Merge branch 'master' of github.com:apple/foundationdb into jfu-test-conf-options 2021-04-12 13:23:18 -04:00
Aaron Molitor 2de2ebd337 add old fdb binaries to build image, update cmake to look in the right place, add new alias to devel image, update FDBTLS lib install for joshua, get the default joshua branch 2021-04-08 12:05:59 -05:00
Steve Atherton 7b08886caf Updated btree unit test name. 2021-04-07 18:29:17 -07:00
Jon Fu 2a64c227fb Added options to test config that specify maxtlogversion and array of excluded storage engine types 2021-04-07 15:59:51 -04:00
Vishesh Yadav cf33cea0b4 loopback_cluster: Find `fdbcli` from `$BUILD` path
Currently expects to find `fdbcli` in current path, which doesn't seem
right. `fdbcli` should always be in the directory where we'll find
`fdbserver`.
2021-04-06 13:44:33 +00:00
Steve Atherton e7573d546f Some unit tests names had a prefixed "!" in order to be excluded from random selection, this has been changed to a ":" as it is less problematic on the command line. Some Redwood unit tests have been enabled for random selection. 2021-04-05 00:03:15 -07:00
Markus Pilman dc35af3760 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-01 11:01:31 -06:00
Jon Fu 69d88dcf96 adjust placement of option in test workload 2021-03-25 15:25:50 -04:00
Jon Fu 1541f4234a Updated test parser with new option and also added option to test file with default value 2021-03-25 14:40:06 -04:00
Markus Pilman eb036b7b02 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-03-17 11:59:54 -06:00
A.J. Beamon 25c4880ebe Merge branch 'release-6.3' into merge-release-6.3-into-master (temporarily discard all changes to BackupContainer.actor.cpp)
# Conflicts:
#	fdbclient/BackupContainer.actor.cpp
#	fdbserver/Knobs.h
2021-03-15 16:41:04 -07:00
A.J. Beamon b7614bad24 Update the multithreaded_client test to work with Python 3 2021-03-10 16:47:33 -08:00
Andrew Noyes 18ee11e69a Use add_fdbclient_test for java integration tests
Also change add_fdbclient_test to run its subcommand with FDB_CLUSTER_FILE set
2021-03-02 01:54:17 +00:00
negoyal e9b7e22e02 Merge branch 'rel-6.3' 2021-02-22 08:47:22 -08:00