wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
20,077 Commits 34 Branches 304 Tags 265 MiB
Commit Graph

20077 Commits

Author SHA1 Message Date
Markus Pilman 9e65e15b45 Merge remote-tracking branch 'origin/main' into features/validate-trace-events-in-simulation 2022-04-22 15:39:55 -06:00
Markus Pilman 681314b0d9
Merge pull request #6937 from sfc-gh-ahusain/ahusain-fix-build 
Fix Build: use boost::hash to compute hash for std::pair
 2022-04-22 15:39:17 -06:00
Ata E Husain Bohra 6c9030408e Fix Build: use boost::hash to compute hash for std::pair 
Description

Fix Build: use boost::hash to compute hash for std::pair

Testing

1. Build - gcc/clang
2. Simulation test: EncryptKeyProxyTest, EncryptionOps
3. Unit test: flow/BlobCipher
4. Running 10k correctness Joshua run
 2022-04-22 13:16:30 -07:00
Sreenath Bodagala 706164d8ae - Address seg fault in "storageRecruiter" actor 2022-04-22 12:38:59 -07:00
Xiaoxi Wang b8fbd18199
Merge pull request #6927 from sfc-gh-xwang/main 
Run completeDest after clear destination set
 2022-04-22 09:23:36 -07:00
Vaidas Gasiunas ac057d79fb
Merge pull request #6930 from sfc-gh-vgasiunas/vgasiunas-upgrade-tests-check-binaries 
Check the hash sum of the dowloaded binaries in the upgrade tests, retry on errors
 2022-04-22 17:59:11 +02:00
Ata E Husain Bohra 670d40ef79
FDB native KMS Connector Framework (#6846) 
* FDB native KMS Connector Framework

Description

Major changes includes:
1. Framework code to enable FDB native KMS connector implementation.
2. SERVER_KNOBS->KMS_CONNECTOR_TYPE controls the connector type selection.
3. KmsConnectorInterface endpoint definitions, every KMSConnector
   implementation needs to support defined endpoints.
4. Update EncryptKeyProxy to leverage KmsConnectorInterface endpoints
   to fetch encryption keys on-demand and/or periodic refreshes.
   Integrate SimKmsConnector implementation.
5. Implement SimKmsConnector by leveraging existing SimKeyProxy
   implementation.

Testing

Unit test: fdbserver/SimKmsConnector
Simulation: EncryptKeyProxy
 2022-04-22 08:53:39 -07:00
Vaidas Gasiunas 0a9b2470da Upgrade Tests: Check the hash sum of the dowloaded files, retry the download on errors 2022-04-22 16:37:11 +02:00
Vaidas Gasiunas 44c5f87ac9
Merge pull request #6919 from sfc-gh-vgasiunas/vgasiunas-client-tmp-dir 
Store client library copies in a build-local temporary directory
 2022-04-22 15:46:57 +02:00
Vaidas Gasiunas 1064035c46 Update generated.go to include the client_tmp_dir option 2022-04-22 14:33:18 +02:00
Vaidas Gasiunas bc0096683f Remove an unused class member 2022-04-22 14:14:09 +02:00
Vaidas Gasiunas 9897712307 Merge remote-tracking branch 'apple/main' into vgasiunas-client-tmp-dir 2022-04-22 13:00:09 +02:00
Vaidas Gasiunas f9cb9deb1d Use build-local temp directory for C API tests 2022-04-22 11:57:29 +02:00
Vaidas Gasiunas 444b6c5479 Default the client temp directory to /tmp 2022-04-22 11:44:44 +02:00
Vaidas Gasiunas caaf43da12
Merge pull request #6900 from sfc-gh-jslocum/bg_client_api_tests 
Blob granule client API tests
 2022-04-22 09:21:31 +02:00
A.J. Beamon 1352083d4c
Merge pull request #6884 from sfc-gh-clin/deprecate-speical-keys 
Remove the client profiling special keys and update related documentations
 2022-04-21 21:51:16 -07:00
Xiaoxi Wang 960a13f233 format 2022-04-21 21:40:49 -07:00
Xiaoxi Wang f9e57396e2 completeDest 2022-04-21 21:23:42 -07:00
Zhe Wang 6c9ff6ee5e
Add sharded rocksdb type (#6862) 
* add-sharded-rocksdb-type

* address comments

Co-authored-by: Zhe Wang <zhewang@Zhes-MacBook-Pro.local>
 2022-04-21 22:53:14 -04:00
Chaoguang Lin 4b1d22d684 Polish the documentation 2022-04-21 19:28:50 -07:00
Ata E Husain Bohra 04ecd8e08f
Revert "Revert "Update 'salt' details for EncryptHeader AuthToken details (#6881)" (#6902)" (#6922) 
Description

Major changes proposed:
1. This reverts commit f38b2e8209.
2. Also add fix for Valgrind failure due to unintialized variables.
3. Improve checks to catch is cipherKey details cached in BlobCipherKeyCache
   isn't as expected

Testing

Overall correctness: 10K (20220421-193911-ahusain-foundationdb-a730e5cb38541e20)
EncyrptionOps correctness: 100K (20220421-194315-ahusain-foundationdb-29c598a8b9420430)
EncryptionOps Valgrind: 100 (20220421-194434-ahusain-foundationdb-7fc5f98eddc0921a)
 2022-04-21 18:57:56 -07:00
Xiaoxi Wang 9f1dceba26 Merge branch 'main' of https://github.com/apple/foundationdb 2022-04-21 16:41:54 -07:00
Ata E Husain Bohra 5b5b45c7cb
Update EKPServer LookupKeysByKeyIds API (#6898) 
* Update EKPServer LookupKeysByKeyIds API

Description

Major changes include:
1. Update EKPServer LookupKeysByKeyIds API to include
   'encryptDomainId' as input along with 'baseCipherId'
2. Unify EKPServer response definition to return
   std::vector<EKPBaseCipherDetails>
3. Update SimKmsProxy interfaces as per above mentioned
   changes.

Testing

1. Update EncryptKeyProxyTest simulation test.
2. Update SimEncyrptKeyProxy unit test
 2022-04-21 14:56:09 -07:00
Chaoguang Lin 879eb98dec Rename registerSpecialKeySpaceModule to registerSpecialKeysImpl 2022-04-21 12:54:34 -07:00
Chaoguang Lin 588041f977 Polish words according to comments 2022-04-21 12:40:32 -07:00
Vaidas Gasiunas b4fa9e23f6 Upgrade Tests: Use build local tmp directory for temp client library copies 2022-04-21 19:27:19 +02:00
Vaidas Gasiunas e48ab69c6b An option to specify a custom directory for temporary client library copies 2022-04-21 19:27:19 +02:00
Chaoguang Lin 9f110b0f51 Update documentations and comments 2022-04-21 10:19:44 -07:00
Tao Lin 98b82f1ac3 Fix GetMappedRange test when rangeResult has more 2022-04-21 10:16:27 -07:00
Markus Pilman f38b2e8209
Revert "Update 'salt' details for EncryptHeader AuthToken details (#6881)" (#6902) 
This reverts commit a38318a6ac.
 2022-04-21 09:04:40 -07:00
Josh Slocum d26db64f08 only adding bg_url knob to local cluster config if blob granules enabled 2022-04-21 10:47:36 -05:00
Markus Pilman bbb1392aad Merge remote-tracking branch 'origin/main' into features/validate-trace-events-in-simulation 2022-04-21 08:24:18 -06:00
Junhyun Shim aefe20e362
Merge pull request #6915 from sfc-gh-vgasiunas/vgasiunas-upgrade-tests-log-dump 
Upgrade Tests: Dump entire log in case of errors
 2022-04-21 16:02:00 +02:00
Vaidas Gasiunas abbc047e5f Upgrade Tests: Dump entire log in case of errors 2022-04-21 10:12:25 +02:00
Xiaoxi Wang 2fd640b0d0 fix doc compilation 2022-04-20 21:27:22 -07:00
Xiaoxi Wang 5d5dae9a0c update release note 2022-04-20 21:27:22 -07:00
Markus Pilman 85757eb47c
Update flow/Trace.cpp 2022-04-20 15:30:42 -06:00
Ivan Goncharov a2a7b959a5 Update bindings/c/CMakeLists.txt 
Co-authored-by: Andrew Noyes <andrew.noyes@snowflake.com>
 2022-04-20 15:56:18 -05:00
imorph 7a46d8b9cd Add new c libs to client package 
Fixes: #6822
 2022-04-20 15:56:18 -05:00
Renxuan Wang e40cc8722c
A few hostname improvements. (#6825) 
* Add tryResolveHostnames() in connection string.

* Add missing hostname to related interfaces.

* Do not pass RequestStream into *GetReplyFromHostname() functions.

Because we are using new RequestStream for each request anyways. Also, the passed in pointer could be nullptr, which results in seg faults.

* Add dynamic hostname resolve and reconnect intervals.

* Address comments.
 2022-04-20 13:42:46 -07:00
Josh Slocum 3c036300cc Addressing review comments 2022-04-20 14:34:19 -05:00
Markus Pilman 3335b2686e
Merge branch 'main' into features/validate-trace-events-in-simulation 2022-04-20 12:03:33 -06:00
Markus Pilman f7a8ebf818
Update flow/Trace.cpp 
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
 2022-04-20 11:55:01 -06:00
Binglin Chang 408c0cf1c9
Fix compile errors on ubuntu 20.04 (#4931) 2022-04-20 10:00:46 -07:00
Josh Slocum 40052c1394 Added Blob Granule API Tester 2022-04-20 10:15:43 -05:00
Josh Slocum 8fa25aa013 Adding blob granule client test target and local cluster setup 2022-04-20 10:15:43 -05:00
Ray Jenkins 5df3bac110
Migrate to OpenTelemetry tracing. (#6855) 2022-04-20 09:26:37 -05:00
Markus Pilman d4ee7be1d7 Reduce excessive tracing and fail after 1M traces 2022-04-19 21:11:51 -06:00
Evan Tschannen 442d2b34c7
fix: pops which were ignored during a snapshot would not be replayed on the proper tlogs within a shared tlog (#6892) 2022-04-19 16:57:41 -07:00
Chaoguang Lin 6bfa4f6ac4 Fix typos; Polish documentations according to comments 2022-04-19 13:57:11 -07:00