Commit Graph

20382 Commits

Author SHA1 Message Date
Junhyun Shim 2f9506f5cd Introduce hard cap to latency sampling & apply clang format 2022-04-26 11:19:48 +02:00
Junhyun Shim 81211989f1 Disable new sample collection after first bad_alloc
- Add more info to --async_xacts description
- Clean up unused macro in fdb_api.hpp
2022-04-26 10:54:39 +02:00
Vaidas Gasiunas e44a906c4b
Merge branch 'main' into fix/make-code-pythonic 2022-04-26 10:48:23 +02:00
Steve Atherton fe338ced8f
Merge pull request #6896 from sfc-gh-mpilman/features/validate-trace-events-in-simulation
Reduce excessive tracing and fail after 1M traces
2022-04-25 18:02:59 -07:00
Xiaoxi Wang 8cc6d9aaac determine timeThrottle and topK dynamically on the shard number 2022-04-25 16:59:20 -07:00
Markus Pilman cbe4a873d2 Merge remote-tracking branch 'origin/main' into features/validate-trace-events-in-simulation 2022-04-25 17:39:29 -06:00
Josh Slocum 5d1afd4c04 Fixing change feed deleted from multiple sources race 2022-04-25 16:51:20 -05:00
Renxuan Wang ec95fb7e74 Disable hostname in simulations.
Hostnames are causing simulation failures. Turn on again in #6926.
2022-04-25 11:05:25 -07:00
Xiaoxi Wang e8477e15ce Merge remote-tracking branch 'upstream/main' into readaware 2022-04-25 09:55:52 -07:00
Ray Jenkins 1c5bf135d5
Revert "Migrate to OpenTelemetry tracing. (#6855)" (#6941)
This reverts commit 5df3bac110.
2022-04-25 09:29:56 -05:00
Vaidas Gasiunas a9ff7b52e4
Merge pull request #6944 from sfc-gh-vgasiunas/vgasiunas-upgrade-test-fix-concurrent-download
Upgrade Tests: Avoid corrupting downloaded files in case of parallel test execution
2022-04-25 16:23:26 +02:00
Junhyun Shim 81f9279db2 Fix GCC error about memset-ing atomic vars 2022-04-25 15:09:29 +02:00
Vaidas Gasiunas 9921a9bd02 Upgrade Tests: Avoid corrupting downloaded files in case of parallel test execution 2022-04-25 15:02:38 +02:00
Junhyun Shim d431a9f11b Wrap platform-specific PATH_MAX header in another 2022-04-25 13:53:05 +02:00
Junhyun Shim c4ac1ab9d0 Fix SGETRANGE 2022-04-25 13:24:56 +02:00
Junhyun Shim cfdff223ff Merge remote-tracking branch 'origin/main' into mako-cpp-async 2022-04-25 13:21:14 +02:00
Junhyun Shim 3536cab730 Apply clang format 2022-04-25 10:48:11 +02:00
Junhyun Shim 6224ea834b Emulate mako.c's commit behavior during populate() 2022-04-25 10:44:20 +02:00
Xiaoxi Wang cc05f5e9db fix getMetrics keys bug 2022-04-24 21:21:18 -07:00
Evan Tschannen a40c8f231a fix: perpetual wiggle would not react to a pause that happened while starting the wiggle 2022-04-24 20:35:02 -07:00
Xiaoxi Wang a0b45c2962 fix throttle bug 2022-04-24 15:51:18 -07:00
Bharadwaj V.R 9b66447783
Merge pull request #6762 from sfc-gh-bvr/block-down
Fail upon running server versions that are too old and incompatible with the newest software that has run on a cluster
2022-04-22 17:28:49 -07:00
Xiaoxi Wang eefd0778c5 change canQueue to timeThrottle() 2022-04-22 15:26:44 -07:00
Bharadwaj V.R 08323de905 fix formatting 2022-04-22 15:10:24 -07:00
Bharadwaj V.R 588b2fa509
Merge branch 'main' into block-down 2022-04-22 14:53:09 -07:00
Bharadwaj V.R 988a70f064
Merge pull request #6858 from sfc-gh-bvr/dbcorever
Track newest and lowest compatible protocol versions in DBCoreState
2022-04-22 14:46:21 -07:00
Bharadwaj V.R 4a5c2268da
Merge branch 'apple:main' into block-down 2022-04-22 14:45:54 -07:00
Xiaoxi Wang 587cd7371d Merge branch 'main' of https://github.com/apple/foundationdb into readaware 2022-04-22 14:44:42 -07:00
Markus Pilman 9e65e15b45 Merge remote-tracking branch 'origin/main' into features/validate-trace-events-in-simulation 2022-04-22 15:39:55 -06:00
Markus Pilman 681314b0d9
Merge pull request #6937 from sfc-gh-ahusain/ahusain-fix-build
Fix Build: use boost::hash to compute hash for std::pair
2022-04-22 15:39:17 -06:00
Xiaoxi Wang 4818f01de9 fix top10 shard index bug; add event detail; fix merge conflict 2022-04-22 14:14:58 -07:00
Junhyun Shim 3205fe8ca4 Fix key selector handling
Also match selectors for OP_(S)GETRANGE
Add Transaction::getKey()
2022-04-22 22:31:32 +02:00
Ata E Husain Bohra 6c9030408e Fix Build: use boost::hash to compute hash for std::pair
Description

Fix Build: use boost::hash to compute hash for std::pair

Testing

1. Build - gcc/clang
2. Simulation test: EncryptKeyProxyTest, EncryptionOps
3. Unit test: flow/BlobCipher
4. Running 10k correctness Joshua run
2022-04-22 13:16:30 -07:00
Sreenath Bodagala 706164d8ae - Address seg fault in "storageRecruiter" actor 2022-04-22 12:38:59 -07:00
Xiaoxi Wang 0639810b66 merge upstream/main 2022-04-22 11:09:15 -07:00
Xiaoxi Wang eb949ee3dc change default shard size; enable valley filler best; top 10 random choice 2022-04-22 10:07:12 -07:00
Xiaoxi Wang b8fbd18199
Merge pull request #6927 from sfc-gh-xwang/main
Run completeDest after clear destination set
2022-04-22 09:23:36 -07:00
Vaidas Gasiunas ac057d79fb
Merge pull request #6930 from sfc-gh-vgasiunas/vgasiunas-upgrade-tests-check-binaries
Check the hash sum of the dowloaded binaries in the upgrade tests, retry on errors
2022-04-22 17:59:11 +02:00
Ata E Husain Bohra 670d40ef79
FDB native KMS Connector Framework (#6846)
* FDB native KMS Connector Framework

Description

Major changes includes:
1. Framework code to enable FDB native KMS connector implementation.
2. SERVER_KNOBS->KMS_CONNECTOR_TYPE controls the connector type selection.
3. KmsConnectorInterface endpoint definitions, every KMSConnector
   implementation needs to support defined endpoints.
4. Update EncryptKeyProxy to leverage KmsConnectorInterface endpoints
   to fetch encryption keys on-demand and/or periodic refreshes.
   Integrate SimKmsConnector implementation.
5. Implement SimKmsConnector by leveraging existing SimKeyProxy
   implementation.

Testing

Unit test: fdbserver/SimKmsConnector
Simulation: EncryptKeyProxy
2022-04-22 08:53:39 -07:00
Bharadwaj V.R 822eb9ec26
Merge branch 'apple:main' into dbcorever 2022-04-22 08:08:34 -07:00
Vaidas Gasiunas 0a9b2470da Upgrade Tests: Check the hash sum of the dowloaded files, retry the download on errors 2022-04-22 16:37:11 +02:00
Vaidas Gasiunas 44c5f87ac9
Merge pull request #6919 from sfc-gh-vgasiunas/vgasiunas-client-tmp-dir
Store client library copies in a build-local temporary directory
2022-04-22 15:46:57 +02:00
Bharadwaj V.R ed08cfbf52
Merge branch 'apple:main' into block-down 2022-04-22 06:19:38 -07:00
Vaidas Gasiunas 1064035c46 Update generated.go to include the client_tmp_dir option 2022-04-22 14:33:18 +02:00
Vaidas Gasiunas bc0096683f Remove an unused class member 2022-04-22 14:14:09 +02:00
Vaidas Gasiunas 9897712307 Merge remote-tracking branch 'apple/main' into vgasiunas-client-tmp-dir 2022-04-22 13:00:09 +02:00
Vaidas Gasiunas f9cb9deb1d Use build-local temp directory for C API tests 2022-04-22 11:57:29 +02:00
Vaidas Gasiunas 444b6c5479 Default the client temp directory to /tmp 2022-04-22 11:44:44 +02:00
Vaidas Gasiunas caaf43da12
Merge pull request #6900 from sfc-gh-jslocum/bg_client_api_tests
Blob granule client API tests
2022-04-22 09:21:31 +02:00
Xiaoxi Wang 04311d001e topK shard random selection 2022-04-21 22:37:16 -07:00