Commit Graph

1145 Commits

Author SHA1 Message Date
sfc-gh-tclinkenbeard c0c8f4de74 Run status workload in ThrouhgputQuota.toml, to enable latency bands 2022-10-26 11:35:01 -07:00
sfc-gh-tclinkenbeard ecac8f68e7 Minor testing improvements for proxy tag throttling 2022-10-25 21:59:41 -07:00
sfc-gh-tclinkenbeard f339819758 Merge remote-tracking branch 'origin/main' into reject-tag-throttled-txns 2022-10-25 11:59:35 -07:00
sfc-gh-tclinkenbeard da4ceaf735 Improve code coverage for proxy-level transaction tag throttling 2022-10-23 10:39:59 -07:00
Chaoguang Lin 78e2871a79
Add a long running test (#8505)
* Add a long running test

* Make new scripts executable and update the test file
2022-10-21 11:11:11 -07:00
Vaidas Gasiunas 70311ee26e
ApiTester: include server configuration, separate ctest for every test file (#8499)
* ApiTester: Include server configuration into TOML files

* ApiTests: Generate a separate ctest target for every API test file

* Fix upgrade test script after refactoring

* ApiTests: test with multiple processes. Limit TLS tests to a single process

* ApiTests: Reformat TOML files without indentation

* ApiTests: adding explicit dependencies on the relevant binaries to the ctest command
2022-10-21 11:53:35 +02:00
Jon Fu c6998a7185 change tenantModes option to accept array of string 2022-10-20 11:44:03 -07:00
Jon Fu 4e016e49e7 replace allowDisablingTenants in newly introduced test file 2022-10-19 14:44:53 -07:00
Jon Fu 04f709c7cb Merge branch 'main' of github.com:apple/foundationdb into tenant-restarting-tests 2022-10-19 14:30:55 -07:00
Jon Fu 702fcd1274 remove allowDisablingTenants flag and add new downgrade test 2022-10-19 14:15:03 -07:00
Nim Wijetunga d439bc1e6e
TenantEntryCache Watch Based Refresh (#8399)
* tenant modification changekey

* address pr comments

* change backup to use watch based tenant cache

* format

* address pr comments

* trigger build

* add todo

* check tenants disabled

* trigger build

* trigger build

* address pr comments

* address pr comments

* trigger build
2022-10-18 19:05:07 -07:00
sfc-gh-tclinkenbeard 300840ea2e Enable GLOBAL_TAG_THROTTLING by default 2022-10-18 15:16:24 -07:00
Ata E Husain Bohra 765aeabb70
Enable EncryptKeyProxy test and add code probes (#8490)
* Enable EncryptKeyProxy test and add code probes

Description

  diff-1: Address review comments

Major changes include:
1. Enable EncryptKeyProxyTest, the test was modified to leverage
GetEncrrptCipherKey actor, as existing code wouldn't work if EKP
process gets restarted while test is running.
2. Add code probes to EKP
3. Minor refactoring.

Testing

EncryptKeyProxyTest - 100K
2022-10-18 13:58:16 -07:00
Xiaoxi Wang a6a53b40fd
Merge pull request #8477 from sfc-gh-xwang/feature/main/moveKey
Implement mock mode moveKeys in MockDDTxnProcessor and simulation test
2022-10-18 11:02:27 -07:00
Jon Fu 930801b483 allow tenantmodes option to specify an array of possible choices 2022-10-18 10:48:27 -07:00
Jingyu Zhou 1b2fcdd4f6
Merge pull request #8053 from sfc-gh-akejriwal/getsizetenant
Make the storage metrics functions tenant aware
2022-10-17 20:02:52 -07:00
Steve Atherton 26cd36472d
Merge pull request #8460 from sfc-gh-yiwu/encrypt_encoding
Fix Redwood xor encoding incompatibility with 7.1
2022-10-17 11:51:27 -07:00
Jon Fu 7969b08f52 change tenantmode type to int and rewrite some reboot logic 2022-10-17 09:38:11 -07:00
Xiaoxi Wang 5743dff0ca extend test time 2022-10-15 22:52:43 -07:00
Ankita Kejriwal 0f9da9d1ad Merge branch 'main' of github.com:apple/foundationdb into getsizetenant 2022-10-14 16:50:51 -07:00
Ankita Kejriwal a24ab2d4fa Incorporate code review comments + workload code cleanup 2022-10-14 13:59:36 -07:00
Markus Pilman da5b5a354e Fix failure injection naming 2022-10-14 11:28:03 -06:00
Markus Pilman a542ca3673 Fix cmake to not run rocksdb tests when compiled without rock 2022-10-14 10:22:50 -06:00
Jingyu Zhou df5825ff65
Merge pull request #8398 from sfc-gh-anoyes/anoyes/idempotency-id2
Initial work for automatic idempotency
2022-10-13 13:07:14 -07:00
Trevor Clinkenbeard b21b04da10
Merge pull request #8466 from sfc-gh-tclinkenbeard/add-fifo-unit-test
Add `/GrvProxyTransactionTagThrottler/Fifo` unit test
2022-10-13 12:20:16 -07:00
sfc-gh-tclinkenbeard 79f0e3fcaa Improve mockFifoClient by waiting on all replies concurrently 2022-10-13 08:37:48 -07:00
Yi Wu a2a372d083 Fix Redwood xor encoding incompatibility with 7.1 2022-10-12 14:19:42 -07:00
He Liu a43e424d8a Merge branch 'main' of https://github.com/apple/foundationdb into validate-data-consistency 2022-10-12 13:01:07 -07:00
Jon Fu ee0027ba76 remove tenantModeRequired flag and disable defaulttenant for cyclerestart test 2022-10-12 12:32:43 -07:00
Nim Wijetunga 8ca6397e97
Enable Backup Tests for Encrypted Snapshots (#8419)
* enable encrypted snapshot backup tests

* address pr comments

* remove tenant cache when decoding

* remove client knob
2022-10-12 10:45:30 -07:00
Chaoguang Lin 2ba98f3a60
Add a cmake option ENABLE_LONG_RUNNING_TESTS (#8364)
* Add a cmake option ENABLE_LONG_RUNNING_TESTS to generate separate correctness package for long running tests

* Remove the unnessary long_running_tests directory

* Use the default bash files
2022-10-11 15:28:07 -07:00
Ankita Kejriwal 7abe785669 Merge branch 'main' of github.com:apple/foundationdb into getsizetenant 2022-10-11 15:03:42 -07:00
Andrew Noyes 6ef8d7ec95 Add AutomaticIdempotencyWorkload 2022-10-11 13:46:39 -07:00
Ankita Kejriwal 11658c7135 Merge branch 'main' of github.com:apple/foundationdb into getsizetenant 2022-10-11 13:09:47 -07:00
Jingyu Zhou 8e616009ce
Merge pull request #8447 from sfc-gh-anoyes/anoyes/disable-knob-for-downgrade
Disable shard_encode_location_metadata for downgrade to 7.1
2022-10-11 12:30:31 -07:00
Andrew Noyes 693f015d69 Remove bogus storage engine exclude types
Originally, storageEngineExcludeTypes was storageEngineExcludeType, and
-1 signified "don't ignore any storage engines". This is no longer
meaningful now that it's a list.
2022-10-11 08:44:07 -07:00
Andrew Noyes 55f091a139 Disable shard_encode_location_metadata for downgrade to 7.1
Using the feature to set knobs from test spec files appears to require
using toml, so also rewrite CycleTestRestart-{1,2}.txt to
CycleTestRestart-{1,2}.toml
2022-10-11 08:44:07 -07:00
Xiaoxi Wang b76268544f disallow workload injection in IDDTxnProcessorApiCorrectness 2022-10-10 22:41:31 -07:00
Ankita Kejriwal 8ed2b85427 Reduce workload flakiness.
* Scale up the workload so that the size for the tenant is large enough
  so that the estimated size will not be rounded down to 0.
* Retry getting the size in the workload (with a delay, upto a maximum
  time) to allow for the size estimate to catch up.
2022-10-10 18:40:31 -07:00
He Liu b52edd8658 Merge branch 'main' of https://github.com/apple/foundationdb into validate-data-consistency 2022-10-10 11:00:05 -07:00
Yi Wu 0d405d0bc9 fix from_7.0.0/UpgradeAndBackupRestore 2022-10-06 20:47:59 -07:00
Yi Wu d247996a17 disabling Redwood for more 7.1.0 restart tests 2022-10-06 17:30:59 -07:00
Yi Wu d4513c73e1 fix 2022-10-06 16:26:51 -07:00
Yi Wu 318d11d98e further disabling Redwood from VersionVector*Restart tests 2022-10-06 15:27:40 -07:00
Yi Wu 43c3f1a30d Fix storageEngineExcludeTypes format in test specs 2022-10-06 14:37:28 -07:00
Andrew Noyes 27e0a16cdb Remove testClass from restart tests
Old binaries don't understand the testClass field, so we can't have it
in test files old binaries might read. In the future we can have it for
7.2+
2022-10-05 15:49:24 -07:00
A.J. Beamon 53593c77ac When updating watches after a database switch, lookup the tenant again to get the ID on the new cluster. Update the switching test to set up tenants properly. 2022-10-03 09:24:13 -07:00
Ankita Kejriwal 999809e79b Increase the data in the workload and add ASSERTs for expected values. 2022-09-29 19:21:44 -07:00
Ankita Kejriwal de90e1aab1 Improve the code in the actors and server, simplify the workload 2022-09-29 18:34:35 -07:00
Ankita Kejriwal 85ba47f4c8 Add a workload to test getEstimatedRangeSizeBytes funtionality 2022-09-29 18:28:39 -07:00