Commit Graph

808 Commits

Author SHA1 Message Date
A.J. Beamon 74487310fa Fix a couple test specification errors 2022-03-17 12:10:19 -07:00
A.J. Beamon ee70837970 Remove some debugging lines, change simulated default cluster frequency, and use a different mechanism to disable tenants for the change feed test. 2022-03-17 12:10:19 -07:00
A.J. Beamon 513e8887dd Add a new C unit test that uses tenants. Fix simulation issue where resetting a transaction could cause in-flight operations to pick up the simulated default tenant for the next retry. Use the new list tenant JSON format in the tenant management test. Fix missing raw_access option in special key space correctness test. 2022-03-17 12:10:19 -07:00
A.J. Beamon 4079b9f23d Lazily assign the default tenant in simulated tests so that we can enforce that raw access isn't used on tenant transactions. Update various tests to avoid using raw access or system key access after they have performed other operations on the transaction. 2022-03-17 12:10:19 -07:00
A.J. Beamon d0dc756c6d Allow disabling tenant mode in simulation. Fix a few bugs. 2022-03-17 12:10:18 -07:00
A.J. Beamon 81e8c7c362 Various test fixes to work with tenants. 2022-03-17 12:10:18 -07:00
A.J. Beamon 05495908b8 Implement some tenant tests 2022-03-17 12:10:18 -07:00
A.J. Beamon 61468dab6d Significantly lower the expected rate in the cache test 2022-03-16 15:26:43 -07:00
A.J. Beamon 6eca71832a Fix disablement of rocksdb tests in simulation 2022-03-16 12:07:03 -07:00
A.J. Beamon 5466253790
Merge pull request #6609 from liquid-helium/avoid-physical-shard-move-test
Skip PhysicalShardMoveTest if RocksDB is not enabled.
2022-03-16 09:29:49 -07:00
Vaidas Gasiunas f4bb82ad56
Merge pull request #6433 from sfc-gh-vgasiunas/vgasiunas-system-tester
A framework for C API tests
2022-03-16 10:49:52 +01:00
He Liu db521f9595 Skip PhysicalShardMoveTest if RocksDB is not enabled. 2022-03-15 16:29:25 -07:00
He Liu c3a68d661e
Physical Shard Move (#6264)
Physical Shard Move part I: Checkpoint creation, transfer and restore.
2022-03-15 13:03:23 -07:00
Vaidas Gasiunas bb7d26a6eb Merge remote-tracking branch 'apple/main' into vgasiunas-system-tester 2022-03-10 19:13:54 +01:00
Tao Lin e2c7c30faf
GetMappedRange support serializable & check RYW & continuation (#6181) 2022-03-10 10:05:44 -08:00
Markus Pilman 2dc75ce5dc
Merge pull request #6495 from Doxense/fix-ignoring-test-exit-code
Fix ignoring test exit codes
2022-03-07 22:36:06 +01:00
A.J. Beamon cdebda35ab
Merge pull request #5725 from sfc-gh-jfu/jfu-grv-cache
Add transaction option for clients to use cached read versions
2022-03-04 09:17:27 -08:00
Vaidas Gasiunas b8386f15d6 ApiTester: configuration for ApiCorrectness workload; Better error handing and reporting 2022-03-04 16:22:49 +01:00
Mohamed Oulmahdi a632d6e43e Fix ignoring test exit codes 2022-03-04 09:38:05 +01:00
sfc-gh-tclinkenbeard 90927cffe9 Set disableHostname=true in CycleTestRestart downgrade test 2022-02-26 17:56:56 -08:00
Markus Pilman 079de5ba57 Enable rocksdb unit tests 2022-02-25 15:38:16 -08:00
Jon Fu 2e2c8bf88c Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-02-22 12:43:55 -05:00
Xiaoxi Wang e3909ad05e modify test file 2022-02-16 11:54:31 -08:00
Xiaoxi Wang 3dfdc6943c move downgrade/upgrade test to XXX_7.1.0 because in 7.0 the workload doesn't have the fix 2022-02-16 10:48:31 -08:00
Jon Fu 7492b755d8 Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-02-14 14:06:49 -05:00
Xiaoxi Wang 5445dd3106 add option to fix consistency check 2022-02-13 23:30:14 -08:00
Xiaoxi Wang 22cf6d8e0e Revert "Revert "add proper downgrade/upgrade test for storage migration with PPW""
This reverts commit 6d3b7c97b8.
2022-02-13 16:10:45 -08:00
Trevor Clinkenbeard 6d3b7c97b8
Revert "add proper downgrade/upgrade test for storage migration with PPW" 2022-02-11 14:37:14 -08:00
Trevor Clinkenbeard 3260ecb32f
Merge pull request #6345 from sfc-gh-xwang/ppw-restarting
add proper downgrade/upgrade test for storage migration with PPW
2022-02-11 11:09:17 -08:00
Trevor Clinkenbeard ef68e6fe0d
Merge pull request #6353 from sfc-gh-ljoswiak/fixes/dynamic-knobs
Fix dynamic knobs correctness issues
2022-02-10 22:13:02 -08:00
A.J. Beamon 2d9a1ff540 Remove the tests from CMakeLists 2022-02-09 15:53:42 -08:00
A.J. Beamon 31aba668a1 Disallow starting the ConfigureTestRestart test from any version before 7.1 because of a bug that causes sporadic failures. 2022-02-09 15:44:50 -08:00
Lukas Joswiak 85da80a9ce Split ConfigIncrement workload
Adds a new ConfigIncrement workload that tests the ability of the
configuration database to remain correct under minority node data loss
situations.
2022-02-09 14:18:40 -08:00
Lukas Joswiak d5a562e6b8 Fix dynamic knobs correctness issues 2022-02-09 13:43:32 -08:00
Mohamed Oulmahdi 23fa27cfde
Merge pull request #6333 from Doxense/add-missing-tests
Add missing tests
2022-02-09 01:03:08 +01:00
Mohamed Oulmahdi e6c16a5e89 Ignore rare/AllSimUnitTests.toml 2022-02-08 22:40:24 +01:00
Xiaoxi Wang 7a904df04f change CMakeList 2022-02-08 11:40:54 -08:00
Xiaoxi Wang 95a3319f92 remove from_7.1.0/ConfigureStorageMigrationTestRestart* because they are in from_7.0.0 2022-02-08 09:08:45 -08:00
Bala Namasivayam a420098fc5 Support AWS v4 header for s3 backup and restore 2022-02-07 17:53:05 -08:00
Jon Fu 9c0a512cf5 Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-02-07 14:51:12 -05:00
Mohamed Oulmahdi 00d1532d32 Remove ClientLibManagement test 2022-02-07 16:54:36 +01:00
Xiaoxi Wang 1172761559 add proper downgrade/upgrade test for storage migration with PPW 2022-02-04 16:43:11 -08:00
Mohamed Oulmahdi f10b549bdf Remove Downgrade test
This test seems broken
2022-02-03 23:52:42 +01:00
Mohamed Oulmahdi 6386eb191a Add missing test files 2022-02-03 22:25:11 +01:00
Ata E Husain Bohra 591ef57857
Upgrade AES 128 GCM -> AES 256, StreamCipher code refactor (#6314)
* Upgrade AES 128 GCM -> AES 256, StreamCipher code refactor

Major changes proposed are:
1. Refactor StreamCipher code to enable instantiation of
   multiple encryption keys. However, code still retains
   a globalEncryption key semantics used in Backup file
   encryption usecase.
2. Enhance StreamCipher to provide HMAC signature digest
   generation. Further, the class implements HMAC encryption
   key derivation function.
3. Upgrade StreamCipher to use AES 256 GCM mode from currently
   supported AES 128 GCM mode.
   Note: The code changes the encryption key size, however, the
         feature is NOT currently in use, hence, should be OK.
3. Add EncryptionOps validation and benchmark toml supported
   workload, it does the following:
   a. Allow user to configure encrypt-decrypt of a fixed size
      buffer or variable size buffer [100, 512K]
   b. Allow user to configure number of interactions of the runs,
      in each iteration: generate random data, derive an encryption
      key using HMAC SHA256 method, encrypt data and
      then decrypt data. It collects following metrics:
    i) time taken to derive encryption key.
    ii) time taken to encrypt the buffer.
    iii) time taken to decrypt the buffer.
    iv) total bytes encrypted and/or decrypted
   c. Along with stats it basic basic validations on the encrypted
      and decrypted buffer
   d. On completion for test, records the above mentioned metrics
      in trace files.
2022-01-31 19:52:44 -06:00
A.J. Beamon 6affc58e97 Rename high contention allocator implementation in fdbclient 2022-01-31 14:25:38 -08:00
A.J. Beamon 027fe80594 Added a generic high contention allocator implementation to fdbclient. This is an adapted version of the flow bindings HCA implementation. 2022-01-28 15:34:30 -08:00
Andrew Noyes 96cbfe668c
Fix flaky ctest tests (#6310)
* Use localhost cluster for trace_partial_file_suffix_test

This way we get a predictable 127.0.0.1 in the trace file name

* Skip suspend test of pidof is not available

* Avoid writing to closed trace log

calling fdb_network_stop sends a "close" message to the trace thread,
but the network thread might can still be running and sending "flush"
messages to the network thread. This change basically ignores any
flushes that come after a close.

* Ensure unique ports for multi-process tests
2022-01-28 13:16:44 -08:00
Lukas Joswiak bd0dcfedb9 Re-enable CycleTestRestart downgrade tests 2022-01-26 19:22:40 -08:00
Chaoguang Lin 9fba84bc45 Change SnapIncrementalRestore.toml to .txt 2022-01-25 14:41:35 -08:00