wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
23,796 Commits 34 Branches 304 Tags 265 MiB
Commit Graph

1174 Commits

Author SHA1 Message Date
Sam Gwydir 7ea42841a4 Merge remote-tracking branch 'origin/main' into ddsketch 2022-11-12 13:52:57 -08:00
Sam Gwydir 23706c957b Use DDSketch for Sample Data. 2022-11-12 13:45:46 -08:00
Ankita Kejriwal 838dfb16c8 Update the simulation testing for storage quota to use/test tenant groups 2022-11-10 19:00:48 -08:00
Vaidas Gasiunas 0160570c2a
Failing client initialization on errors in external clients; Update package version to 7.3.0 (#8719) 
* Network setup to fail on the initialization failures of external clients

* MVC: A more intuitive error when failing to load an API function

* Testing initializing FDB client with different configuration options

* Enable strict external client configuration check only for new API versions

* Upgrade FDB package version to 7.3.0; Update upgrade tests
 2022-11-10 13:01:41 +01:00
Ankita Kejriwal 105648b888 Merge branch 'main' of github.com:apple/foundationdb into commitproxies 2022-11-09 17:38:30 -08:00
Chaoguang Lin 9a643286cb
Make the hardcoded timeouts as parameters in test files; Also longRunningTest para to disable Simulation timeout restriction (#8765) 2022-11-09 16:57:51 -08:00
Nim Wijetunga f1ef9d2671
Fix Bulk Load With Tenants Workload (#8754) 
* fix bulk load

* Trigger Build
 2022-11-09 13:18:34 -08:00
Ankita Kejriwal 3b9431e281 Add testing for rejecting transactions of tenants over storage quota 2022-11-07 16:44:54 -08:00
He Liu d28187ca90
Do not set timeout for RocksDB reads in simulation. (#8716) 
* Do not set timeout for RocksDB reads in simulation.

* Cleanup.

* Ignore validateStorage test.
 2022-11-07 15:59:52 -08:00
He Liu bffa838398
Checkpoint restore with shard (#8667) 
* Added SSPhysicalShard.

* Update physicalShards in StorageServer::addShard().

* Handle notAssigned shard.

* fetchKeys() are not stopped during TerminateStorageServer since
physicalShards are not cleared.

* Fixed addingSplitLeft unset shardId.

* Increased the timeout for Rocks reads in simulation.

* Cleanup.

* set SERVE_AUDIT_STORAGE_PARALLELISM to 1.

* Disabled ValidateStorage test.

* Resolved comments.

Co-authored-by: He Liu <heliu@apple.com>
 2022-11-07 10:02:35 -08:00
Junhyun Shim 1ee1b6ce4d
Merge pull request #8631 from sfc-gh-vgasiunas/vgasiunas-fdbmonitor-in-python 
Avoid local cluster tests creating zombie fdbmonitor processes
 2022-11-07 14:47:36 +01:00
Vaidas Gasiunas ce3038bfe5
Use a network option for retaining temporary client lib copies instead of a client knob (#8630) 2022-11-07 14:46:17 +01:00
Vaidas Gasiunas 286f9b729a Merge remote-tracking branch 'apple/main' into vgasiunas-fdbmonitor-in-python 2022-11-07 10:33:06 +01:00
sfc-gh-tclinkenbeard 92e21de362 Disable ThroughputQuota.toml test 2022-11-03 15:07:02 -07:00
Vaidas Gasiunas 18b852c4e4
Improving troubleshooting of stopping the FDB client thread (#8629) 
* Upgrade tests: dump thread call stacks of the tester process if it fails to terminate

* ApiTester: log before and after stopping the network thread

* Catch and print exceptions in closeTraceFile; Close trace file at the end of MVC runNetwork

* Change trace event name for MVC runNetwork termination

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
 2022-11-03 13:20:21 +01:00
Vaidas Gasiunas 423049f0f8 Merge remote-tracking branch 'apple/main' into vgasiunas-fdbmonitor-in-python 2022-11-03 10:56:54 +01:00
Yao Xiao 471637f74d
Exclude cluster tests from tests/SpecificUnitTest.toml (#8641) 2022-11-02 10:34:33 -07:00
Trevor Clinkenbeard 39abc712b0
Merge pull request #8549 from sfc-gh-tclinkenbeard/expose-txn-cost 
Create `fdb_transaction_get_total_cost` function
 2022-11-01 08:14:57 -07:00
Yao Xiao 891a5bee10
Add timeout for long running test. (#8634) 2022-10-31 11:19:58 -07:00
Vaidas Gasiunas 0802bbfbb0 Avoid local_cluster.py creating zombie fdbmonitor processes 2022-10-31 15:59:02 +01:00
sfc-gh-tclinkenbeard 0eb1598afa Merge remote-tracking branch 'origin/main' into expose-txn-cost 2022-10-30 09:36:37 -07:00
sfc-gh-tclinkenbeard 1d6bd0057b Merge remote-tracking branch 'origin/main' into add-tag-throttling-latency-bands 2022-10-29 09:49:37 -07:00
Evan Tschannen dd970a5c99 Specific unit test should only run one tests instead of all tests 2022-10-28 10:55:20 -07:00
sfc-gh-tclinkenbeard 6ae0aac153 Merge remote-tracking branch 'origin/main' into add-tag-throttling-latency-bands 2022-10-27 14:07:51 -07:00
Nim Wijetunga bf01d9b879
Bulk Setup Workload Improvements (#8573) 
* bulk setup  workload improvements

* fix workload

* modify
 2022-10-27 11:10:14 -07:00
Josh Slocum 4d3553481f
Blob connection provider test (#8478) 
* Refactoring test blob metadata creation

* Implementing BlobConnectionProviderTest

* createRandomTestBlobMetadata supports blobstore and works outside simulation
 2022-10-27 10:44:06 -05:00
sfc-gh-tclinkenbeard c0c8f4de74 Run status workload in ThrouhgputQuota.toml, to enable latency bands 2022-10-26 11:35:01 -07:00
Nim Wijetunga 6f37f55917
Restore System Keys First in Backup/Restore Workloads (#8475) 
* system key restore ordering

* restore system keys before regular data

* atomic restore backup fix

* change testing

* fix compile error

* fix compile issue

* fix compile issues

* Trigger Build

* only split restore if encryption is enabled

* revert knob changes

* Update fdbserver/workloads/AtomicSwitchover.actor.cpp

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update fdbserver/workloads/AtomicSwitchover.actor.cpp

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update fdbserver/workloads/BackupCorrectness.actor.cpp

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update fdbserver/workloads/AtomicRestore.actor.cpp

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* add todo

* strengthen check

* seperate system restore for atomic restore

* address pr comments

* address pr comments

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
 2022-10-26 09:38:27 -07:00
sfc-gh-tclinkenbeard ecac8f68e7 Minor testing improvements for proxy tag throttling 2022-10-25 21:59:41 -07:00
sfc-gh-tclinkenbeard f339819758 Merge remote-tracking branch 'origin/main' into reject-tag-throttled-txns 2022-10-25 11:59:35 -07:00
sfc-gh-tclinkenbeard 32ae7bb529 Merge remote-tracking branch 'origin/main' into expose-txn-cost 2022-10-23 12:59:07 -07:00
sfc-gh-tclinkenbeard da4ceaf735 Improve code coverage for proxy-level transaction tag throttling 2022-10-23 10:39:59 -07:00
Chaoguang Lin 78e2871a79
Add a long running test (#8505) 
* Add a long running test

* Make new scripts executable and update the test file
 2022-10-21 11:11:11 -07:00
Vaidas Gasiunas 70311ee26e
ApiTester: include server configuration, separate ctest for every test file (#8499) 
* ApiTester: Include server configuration into TOML files

* ApiTests: Generate a separate ctest target for every API test file

* Fix upgrade test script after refactoring

* ApiTests: test with multiple processes. Limit TLS tests to a single process

* ApiTests: Reformat TOML files without indentation

* ApiTests: adding explicit dependencies on the relevant binaries to the ctest command
 2022-10-21 11:53:35 +02:00
Jon Fu c6998a7185 change tenantModes option to accept array of string 2022-10-20 11:44:03 -07:00
Jon Fu 4e016e49e7 replace allowDisablingTenants in newly introduced test file 2022-10-19 14:44:53 -07:00
Jon Fu 04f709c7cb Merge branch 'main' of github.com:apple/foundationdb into tenant-restarting-tests 2022-10-19 14:30:55 -07:00
Jon Fu 702fcd1274 remove allowDisablingTenants flag and add new downgrade test 2022-10-19 14:15:03 -07:00
Nim Wijetunga d439bc1e6e
TenantEntryCache Watch Based Refresh (#8399) 
* tenant modification changekey

* address pr comments

* change backup to use watch based tenant cache

* format

* address pr comments

* trigger build

* add todo

* check tenants disabled

* trigger build

* trigger build

* address pr comments

* address pr comments

* trigger build
 2022-10-18 19:05:07 -07:00
sfc-gh-tclinkenbeard 300840ea2e Enable GLOBAL_TAG_THROTTLING by default 2022-10-18 15:16:24 -07:00
Ata E Husain Bohra 765aeabb70
Enable EncryptKeyProxy test and add code probes (#8490) 
* Enable EncryptKeyProxy test and add code probes

Description

  diff-1: Address review comments

Major changes include:
1. Enable EncryptKeyProxyTest, the test was modified to leverage
GetEncrrptCipherKey actor, as existing code wouldn't work if EKP
process gets restarted while test is running.
2. Add code probes to EKP
3. Minor refactoring.

Testing

EncryptKeyProxyTest - 100K
 2022-10-18 13:58:16 -07:00
Xiaoxi Wang a6a53b40fd
Merge pull request #8477 from sfc-gh-xwang/feature/main/moveKey 
Implement mock mode moveKeys in MockDDTxnProcessor and simulation test
 2022-10-18 11:02:27 -07:00
Jon Fu 930801b483 allow tenantmodes option to specify an array of possible choices 2022-10-18 10:48:27 -07:00
Jingyu Zhou 1b2fcdd4f6
Merge pull request #8053 from sfc-gh-akejriwal/getsizetenant 
Make the storage metrics functions tenant aware
 2022-10-17 20:02:52 -07:00
Steve Atherton 26cd36472d
Merge pull request #8460 from sfc-gh-yiwu/encrypt_encoding 
Fix Redwood xor encoding incompatibility with 7.1
 2022-10-17 11:51:27 -07:00
Jon Fu 7969b08f52 change tenantmode type to int and rewrite some reboot logic 2022-10-17 09:38:11 -07:00
sfc-gh-tclinkenbeard 84aa815026 Implemented first version of Transaction::getTotalCost, along with workload 2022-10-16 21:58:08 -07:00
Xiaoxi Wang 5743dff0ca extend test time 2022-10-15 22:52:43 -07:00
Ankita Kejriwal 0f9da9d1ad Merge branch 'main' of github.com:apple/foundationdb into getsizetenant 2022-10-14 16:50:51 -07:00
Ankita Kejriwal a24ab2d4fa Incorporate code review comments + workload code cleanup 2022-10-14 13:59:36 -07:00