Commit Graph

485 Commits

Author SHA1 Message Date
Hui Liu e3bf79cf71 Add correctness test for blob restore 2023-01-04 11:10:34 -08:00
Junhyun Shim 36b4569a08 Merge remote-tracking branch 'origin/main' into mako-authz-token-generation 2022-12-07 08:49:20 +01:00
Chaoguang Lin 4dbfa01fbf
Add a new robustness workload for testing special keys (#8957)
* Add a new robustness workload for testing special keys

* Fix a few robustness related issues and remove duplicate tests

* Add comments
2022-12-05 14:05:26 -08:00
Vaidas Gasiunas 493ab95464
Define the old FDB release versions used for client testing in one place (#8888)
* Auto-formatting fdb_c_shim_tests.py

* Define the old release versions used for testing in one place; Using PYTHONPATH to find python modules from other project directories

* Remove obsolete upgrade tests; add direct upgrade tests from older versions

* Trigger tests
2022-11-25 13:16:33 +01:00
Junhyun Shim 72b4dc9852 Make client tests run in venv 2022-11-22 18:20:28 +01:00
Marian Dvorsky f7d1310d0d
Suppress LSAN leak reports from ConnectionReaderActorState (#8889) 2022-11-21 17:58:22 +01:00
Junhyun Shim ce041576f5 Merge remote-tracking branch 'origin/main' into authz-security-tests 2022-11-17 22:44:31 +01:00
Steve Atherton 8e8c4b4489
Merge pull request #8170 from sfc-gh-sgwydir/ddsketch
Use DDSketch for sample data
2022-11-17 10:38:12 -08:00
Junhyun Shim 7c65ca6648 Merge remote-tracking branch 'origin/main' into authz-security-tests 2022-11-17 17:48:44 +01:00
Xiaoxi Wang 6b77bcfc35 fix merge conflict upstream/main 2022-11-16 07:34:42 -08:00
Junhyun Shim 632bddd4de Merge remote-tracking branch 'origin/main' into authz-security-tests 2022-11-16 10:18:34 +01:00
Steve Atherton 959f77d03d
Merge pull request #8730 from sfc-gh-xwang/fix/main/restoreStats
Fix the omit StorageWiggler.restoreStats() bug
2022-11-15 22:37:39 -08:00
Xiaoxi Wang 907d7af966 solve merge conflict upstream/main 2022-11-15 14:59:31 -08:00
Sam Gwydir 99d4bacf5d Merge remote-tracking branch 'origin/main' into ddsketch 2022-11-15 13:19:42 -08:00
sfc-gh-tclinkenbeard 696c451fa6 Reenable ThroughputQuota.toml test 2022-11-15 12:58:34 -08:00
Sam Gwydir 23706c957b Use DDSketch for Sample Data. 2022-11-12 13:45:46 -08:00
Xiaoxi Wang b79268326a Merge branch 'main' of https://github.com/apple/foundationdb into feature/main/dataApi 2022-11-11 08:29:22 -08:00
Xiaoxi Wang 62b88a0772 wait on lock take 2022-11-09 11:34:47 -08:00
Xiaoxi Wang fd425db1cf fix rawStartMovement bugs for merge shard; change the test toml file name 2022-11-08 23:37:58 -08:00
Xiaoxi Wang 4727449ef0 Merge branch 'main' of https://github.com/apple/foundationdb into fix/main/restoreStats 2022-11-08 15:35:15 -08:00
Junhyun Shim 66e3050062 Merge remote-tracking branch 'origin/main' into authz-security-tests 2022-11-08 13:15:37 +01:00
He Liu d28187ca90
Do not set timeout for RocksDB reads in simulation. (#8716)
* Do not set timeout for RocksDB reads in simulation.

* Cleanup.

* Ignore validateStorage test.
2022-11-07 15:59:52 -08:00
He Liu bffa838398
Checkpoint restore with shard (#8667)
* Added SSPhysicalShard.

* Update physicalShards in StorageServer::addShard().

* Handle notAssigned shard.

* fetchKeys() are not stopped during TerminateStorageServer since
physicalShards are not cleared.

* Fixed addingSplitLeft unset shardId.

* Increased the timeout for Rocks reads in simulation.

* Cleanup.

* set SERVE_AUDIT_STORAGE_PARALLELISM to 1.

* Disabled ValidateStorage test.

* Resolved comments.

Co-authored-by: He Liu <heliu@apple.com>
2022-11-07 10:02:35 -08:00
Xiaoxi Wang 03a9dd009a fix compilation errors 2022-11-06 22:46:54 -08:00
sfc-gh-tclinkenbeard 92e21de362 Disable ThroughputQuota.toml test 2022-11-03 15:07:02 -07:00
sfc-gh-tclinkenbeard 0eb1598afa Merge remote-tracking branch 'origin/main' into expose-txn-cost 2022-10-30 09:36:37 -07:00
Junhyun Shim 085e38cdfd Merge remote-tracking branch 'origin/main' into authz-security-tests 2022-10-26 15:09:02 +02:00
Junhyun Shim 8e752309c0 Add cross-tenant commit/get + TLog peek security tests 2022-10-26 12:51:59 +02:00
sfc-gh-tclinkenbeard f339819758 Merge remote-tracking branch 'origin/main' into reject-tag-throttled-txns 2022-10-25 11:59:35 -07:00
sfc-gh-tclinkenbeard 32ae7bb529 Merge remote-tracking branch 'origin/main' into expose-txn-cost 2022-10-23 12:59:07 -07:00
Chaoguang Lin 78e2871a79
Add a long running test (#8505)
* Add a long running test

* Make new scripts executable and update the test file
2022-10-21 11:11:11 -07:00
Jon Fu 04f709c7cb Merge branch 'main' of github.com:apple/foundationdb into tenant-restarting-tests 2022-10-19 14:30:55 -07:00
Jon Fu 702fcd1274 remove allowDisablingTenants flag and add new downgrade test 2022-10-19 14:15:03 -07:00
sfc-gh-tclinkenbeard 300840ea2e Enable GLOBAL_TAG_THROTTLING by default 2022-10-18 15:16:24 -07:00
Ata E Husain Bohra 765aeabb70
Enable EncryptKeyProxy test and add code probes (#8490)
* Enable EncryptKeyProxy test and add code probes

Description

  diff-1: Address review comments

Major changes include:
1. Enable EncryptKeyProxyTest, the test was modified to leverage
GetEncrrptCipherKey actor, as existing code wouldn't work if EKP
process gets restarted while test is running.
2. Add code probes to EKP
3. Minor refactoring.

Testing

EncryptKeyProxyTest - 100K
2022-10-18 13:58:16 -07:00
sfc-gh-tclinkenbeard 84aa815026 Implemented first version of Transaction::getTotalCost, along with workload 2022-10-16 21:58:08 -07:00
Ankita Kejriwal 0f9da9d1ad Merge branch 'main' of github.com:apple/foundationdb into getsizetenant 2022-10-14 16:50:51 -07:00
Markus Pilman da5b5a354e Fix failure injection naming 2022-10-14 11:28:03 -06:00
Markus Pilman a542ca3673 Fix cmake to not run rocksdb tests when compiled without rock 2022-10-14 10:22:50 -06:00
Jingyu Zhou df5825ff65
Merge pull request #8398 from sfc-gh-anoyes/anoyes/idempotency-id2
Initial work for automatic idempotency
2022-10-13 13:07:14 -07:00
He Liu a43e424d8a Merge branch 'main' of https://github.com/apple/foundationdb into validate-data-consistency 2022-10-12 13:01:07 -07:00
Chaoguang Lin 2ba98f3a60
Add a cmake option ENABLE_LONG_RUNNING_TESTS (#8364)
* Add a cmake option ENABLE_LONG_RUNNING_TESTS to generate separate correctness package for long running tests

* Remove the unnessary long_running_tests directory

* Use the default bash files
2022-10-11 15:28:07 -07:00
Ankita Kejriwal 7abe785669 Merge branch 'main' of github.com:apple/foundationdb into getsizetenant 2022-10-11 15:03:42 -07:00
Andrew Noyes 6ef8d7ec95 Add AutomaticIdempotencyWorkload 2022-10-11 13:46:39 -07:00
Ankita Kejriwal 11658c7135 Merge branch 'main' of github.com:apple/foundationdb into getsizetenant 2022-10-11 13:09:47 -07:00
Andrew Noyes 55f091a139 Disable shard_encode_location_metadata for downgrade to 7.1
Using the feature to set knobs from test spec files appears to require
using toml, so also rewrite CycleTestRestart-{1,2}.txt to
CycleTestRestart-{1,2}.toml
2022-10-11 08:44:07 -07:00
He Liu b52edd8658 Merge branch 'main' of https://github.com/apple/foundationdb into validate-data-consistency 2022-10-10 11:00:05 -07:00
Ankita Kejriwal 85ba47f4c8 Add a workload to test getEstimatedRangeSizeBytes funtionality 2022-09-29 18:28:39 -07:00
Nim Wijetunga 232e23c87e
Snapshot Backup Encryption (#8095)
* inital commit

* add encryption support

* refactor passing encryption keys

* disable encryption codepath

* pass enable encryption cli arg for fdbbackup

* change encryption key passing

* only enable encryption for backup if tenant mode is required

* revert server knobs

* ignore json trace files

* --amend

* integrate ekp

* add comments

* comments

* comments

* revert knobs

* fix bug

* modify encrypted backup logic

* use common prefix

* check boundaries between begin and end key

* return system encrypt domain

* modify

* add tenant entry cache to backup

* slight revert

* format

* Trigger Build

* format

* use tenant name to fetch keys

* Trigger Build

* Trigger Build

* merge

* fix getting ekp

* fix bug

* address pr comments

* Trigger Build

* Trigger Build

* remove faulty check
2022-09-29 14:45:47 -07:00
Xiaoxi Wang 3578832c69 merge upstream/main 2022-09-28 14:01:50 -07:00