Commit Graph

793 Commits

Author SHA1 Message Date
Tao Lin e2c7c30faf
GetMappedRange support serializable & check RYW & continuation (#6181) 2022-03-10 10:05:44 -08:00
Markus Pilman 2dc75ce5dc
Merge pull request #6495 from Doxense/fix-ignoring-test-exit-code
Fix ignoring test exit codes
2022-03-07 22:36:06 +01:00
A.J. Beamon cdebda35ab
Merge pull request #5725 from sfc-gh-jfu/jfu-grv-cache
Add transaction option for clients to use cached read versions
2022-03-04 09:17:27 -08:00
Mohamed Oulmahdi a632d6e43e Fix ignoring test exit codes 2022-03-04 09:38:05 +01:00
sfc-gh-tclinkenbeard 90927cffe9 Set disableHostname=true in CycleTestRestart downgrade test 2022-02-26 17:56:56 -08:00
Markus Pilman 079de5ba57 Enable rocksdb unit tests 2022-02-25 15:38:16 -08:00
Jon Fu 2e2c8bf88c Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-02-22 12:43:55 -05:00
Xiaoxi Wang e3909ad05e modify test file 2022-02-16 11:54:31 -08:00
Xiaoxi Wang 3dfdc6943c move downgrade/upgrade test to XXX_7.1.0 because in 7.0 the workload doesn't have the fix 2022-02-16 10:48:31 -08:00
Jon Fu 7492b755d8 Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-02-14 14:06:49 -05:00
Xiaoxi Wang 5445dd3106 add option to fix consistency check 2022-02-13 23:30:14 -08:00
Xiaoxi Wang 22cf6d8e0e Revert "Revert "add proper downgrade/upgrade test for storage migration with PPW""
This reverts commit 6d3b7c97b8.
2022-02-13 16:10:45 -08:00
Trevor Clinkenbeard 6d3b7c97b8
Revert "add proper downgrade/upgrade test for storage migration with PPW" 2022-02-11 14:37:14 -08:00
Trevor Clinkenbeard 3260ecb32f
Merge pull request #6345 from sfc-gh-xwang/ppw-restarting
add proper downgrade/upgrade test for storage migration with PPW
2022-02-11 11:09:17 -08:00
Trevor Clinkenbeard ef68e6fe0d
Merge pull request #6353 from sfc-gh-ljoswiak/fixes/dynamic-knobs
Fix dynamic knobs correctness issues
2022-02-10 22:13:02 -08:00
A.J. Beamon 2d9a1ff540 Remove the tests from CMakeLists 2022-02-09 15:53:42 -08:00
A.J. Beamon 31aba668a1 Disallow starting the ConfigureTestRestart test from any version before 7.1 because of a bug that causes sporadic failures. 2022-02-09 15:44:50 -08:00
Lukas Joswiak 85da80a9ce Split ConfigIncrement workload
Adds a new ConfigIncrement workload that tests the ability of the
configuration database to remain correct under minority node data loss
situations.
2022-02-09 14:18:40 -08:00
Lukas Joswiak d5a562e6b8 Fix dynamic knobs correctness issues 2022-02-09 13:43:32 -08:00
Mohamed Oulmahdi 23fa27cfde
Merge pull request #6333 from Doxense/add-missing-tests
Add missing tests
2022-02-09 01:03:08 +01:00
Mohamed Oulmahdi e6c16a5e89 Ignore rare/AllSimUnitTests.toml 2022-02-08 22:40:24 +01:00
Xiaoxi Wang 7a904df04f change CMakeList 2022-02-08 11:40:54 -08:00
Xiaoxi Wang 95a3319f92 remove from_7.1.0/ConfigureStorageMigrationTestRestart* because they are in from_7.0.0 2022-02-08 09:08:45 -08:00
Bala Namasivayam a420098fc5 Support AWS v4 header for s3 backup and restore 2022-02-07 17:53:05 -08:00
Jon Fu 9c0a512cf5 Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-02-07 14:51:12 -05:00
Mohamed Oulmahdi 00d1532d32 Remove ClientLibManagement test 2022-02-07 16:54:36 +01:00
Xiaoxi Wang 1172761559 add proper downgrade/upgrade test for storage migration with PPW 2022-02-04 16:43:11 -08:00
Mohamed Oulmahdi f10b549bdf Remove Downgrade test
This test seems broken
2022-02-03 23:52:42 +01:00
Mohamed Oulmahdi 6386eb191a Add missing test files 2022-02-03 22:25:11 +01:00
Ata E Husain Bohra 591ef57857
Upgrade AES 128 GCM -> AES 256, StreamCipher code refactor (#6314)
* Upgrade AES 128 GCM -> AES 256, StreamCipher code refactor

Major changes proposed are:
1. Refactor StreamCipher code to enable instantiation of
   multiple encryption keys. However, code still retains
   a globalEncryption key semantics used in Backup file
   encryption usecase.
2. Enhance StreamCipher to provide HMAC signature digest
   generation. Further, the class implements HMAC encryption
   key derivation function.
3. Upgrade StreamCipher to use AES 256 GCM mode from currently
   supported AES 128 GCM mode.
   Note: The code changes the encryption key size, however, the
         feature is NOT currently in use, hence, should be OK.
3. Add EncryptionOps validation and benchmark toml supported
   workload, it does the following:
   a. Allow user to configure encrypt-decrypt of a fixed size
      buffer or variable size buffer [100, 512K]
   b. Allow user to configure number of interactions of the runs,
      in each iteration: generate random data, derive an encryption
      key using HMAC SHA256 method, encrypt data and
      then decrypt data. It collects following metrics:
    i) time taken to derive encryption key.
    ii) time taken to encrypt the buffer.
    iii) time taken to decrypt the buffer.
    iv) total bytes encrypted and/or decrypted
   c. Along with stats it basic basic validations on the encrypted
      and decrypted buffer
   d. On completion for test, records the above mentioned metrics
      in trace files.
2022-01-31 19:52:44 -06:00
A.J. Beamon 6affc58e97 Rename high contention allocator implementation in fdbclient 2022-01-31 14:25:38 -08:00
A.J. Beamon 027fe80594 Added a generic high contention allocator implementation to fdbclient. This is an adapted version of the flow bindings HCA implementation. 2022-01-28 15:34:30 -08:00
Andrew Noyes 96cbfe668c
Fix flaky ctest tests (#6310)
* Use localhost cluster for trace_partial_file_suffix_test

This way we get a predictable 127.0.0.1 in the trace file name

* Skip suspend test of pidof is not available

* Avoid writing to closed trace log

calling fdb_network_stop sends a "close" message to the trace thread,
but the network thread might can still be running and sending "flush"
messages to the network thread. This change basically ignores any
flushes that come after a close.

* Ensure unique ports for multi-process tests
2022-01-28 13:16:44 -08:00
Lukas Joswiak bd0dcfedb9 Re-enable CycleTestRestart downgrade tests 2022-01-26 19:22:40 -08:00
Chaoguang Lin 9fba84bc45 Change SnapIncrementalRestore.toml to .txt 2022-01-25 14:41:35 -08:00
Chaoguang Lin 262e94637a Add the comment for the temporary change 2022-01-25 14:41:35 -08:00
Chaoguang Lin 7452f47f82 Disable downgrade test to 7.0 2022-01-25 14:41:35 -08:00
Chaoguang Lin 863ea8000c Split ConfigureTestRestart test to 7.0 and 7.1; remove [configuration] in SnapIncrementalRestore-1.toml; revert CycleTestRestart-1.toml to .txt 2022-01-25 14:41:35 -08:00
Chaoguang Lin d0c21948a6 Revert "Use toml for snapshot test files"
This reverts commit 6b81065b32.
2022-01-25 14:41:35 -08:00
Jon Fu 5d9843ec32 Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-01-24 13:20:51 -05:00
Renxuan Wang 334ba66348 Add the support for using hostname in simulation.
This PR does NOT turn the feature on. Also, disable hostname in downgrade restarting tests.
2022-01-21 10:48:33 -08:00
Jon Fu 915e2f6c1c Merge branch 'main' of github.com:apple/foundationdb into jfu-grv-cache 2022-01-20 16:17:20 -05:00
Jon Fu 5757e2c93c Ignore RocksDB unit test 2022-01-06 13:34:50 -05:00
Jon Fu 93c5efc918 Check RocksDB flag in CMakeLists 2022-01-05 21:48:49 -05:00
Jon Fu e5f7883f63 Ignore RocksDB unit test by default because correctness breaks when RocksDB is not included 2022-01-05 21:47:05 -05:00
He Liu 30b3789316
Merge pull request #6195 from liquid-helium/range-deletion-to-single-deletion
Implement single deletion in RocksDB.
2022-01-04 12:55:58 -08:00
He Liu 1c2c2783ea Implement single deletion in RocksDB.
If the target deletion range contains a single key, convert it into a
single deletion, to avoid extra cost in RocksDB due to range deletion.
2022-01-04 09:59:40 -08:00
Andrew Noyes 9ca514401d Suppress known asan stderr message 2021-12-22 15:04:30 -08:00
Andrew Noyes 6fdbd9ae30 Fail test if there's a sev40 in the logs, and output logs if test fails 2021-12-22 15:03:37 -08:00
Andrew Noyes ebb570422b Format tmp_cluster.py with black 2021-12-22 15:01:54 -08:00