wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
22,048 Commits 34 Branches 304 Tags 265 MiB
Commit Graph

22048 Commits

Author SHA1 Message Date
Dennis Zhou 3d400cff64 blob: verifyBlobRange() c api 2022-08-16 13:29:23 -07:00
Dennis Zhou 045076339d bindings/java: implement getBlobGranuleRanges() bindings 2022-08-16 13:29:23 -07:00
Dennis Zhou 1c2109dcbd blob: add rangeLimit to getBlobGranuleRanges() 2022-08-16 13:29:23 -07:00
Dennis Zhou 03d5942859 blob/java: listBlobbifiedRanges java bindings 2022-08-16 13:29:23 -07:00
Dennis Zhou e4f433a480 bindings/java: add KeyRange bindings 2022-08-16 13:29:23 -07:00
Dennis Zhou d2fd29dc52 blob/java: add (un)blobbifyRange api 2022-08-16 13:29:23 -07:00
Dennis Zhou 2d6b2e490c blob/java: make purgeBlobGranules signatures match 2022-08-16 13:29:23 -07:00
Dennis Zhou ba148ba6f1 blob/java: add default executor functions for purgeBlobGranules 2022-08-16 13:29:23 -07:00
Dennis Zhou 96f3dd67b0 blob: add listBlobbifiedRanges() api 2022-08-16 13:29:20 -07:00
Xiaoxi Wang 25f1d3f4d8 rename Interface class; move IDDTeamCollection to DDTeamCollection file 2022-08-16 12:15:21 -07:00
Mohamed Oulmahdi b13b5bb543 Force CI restart 2022-08-16 21:09:09 +02:00
Xiaoxi Wang c3b51160f1 Merge branch 'main' of https://github.com/apple/foundationdb into refactor/main/ddEnabledState 2022-08-16 11:51:34 -07:00
Mohamed Oulmahdi c8741385b2 Fix Windows build broken by #7823 2022-08-16 15:39:24 +02:00
Dennis Zhou cbe9fba5e9 blob: (un)blobbifyRange() c api 2022-08-15 16:25:36 -07:00
Dennis Zhou de732c2603 bindings: add FutureBool future type 2022-08-15 16:25:36 -07:00
Dennis Zhou 5085c21d0d blob: check if blob range exists and fail accordingly 2022-08-15 16:25:36 -07:00
Dennis Zhou 736ef4f2c9 blob: move blobrange command implementation to native api 2022-08-15 16:25:36 -07:00
Dennis Zhou 8c33aa7b1d blob: create named values for blobRangeActive/blobRangeInactive 
blobRangeActive = LiteralStringRef("1")
blobRangeInactive = LiteralStringRef("")
 2022-08-15 16:25:36 -07:00
Balachandar Namasivayam b758c9aaf8
Merge pull request #7896 from bnamasivayam/fix-transaction-analyzer-error-commit 
Fix ErrorCommitInfo event parser
 2022-08-15 15:41:56 -07:00
Xiaoge Su 751cf6a721 fixup! typo 2022-08-15 15:25:20 -07:00
Xiaoge Su c4d1231914 Remove ItemWithExamples, replace by Samples 
This is a fully cleanup of ItemWithExamples with a new Samples class.
 2022-08-15 15:25:20 -07:00
Xiaoge Su 1dfa23ea1b fixup! clang-format 2022-08-15 15:25:20 -07:00
Xiaoge Su 68dc99ea0f Refactor ClientStatusStats and ClientStats 
MonitorLeader.actor.cpp:ClientStatusStats and
Status.actor.cpp:ClientStats shares the same structure, thus refactored.
 2022-08-15 15:25:20 -07:00
Josh Slocum 2448d9e6dc
Merge pull request #7883 from sfc-gh-satherton/remove-fkreenablelb-spam 
Remove extremely spammy trace event in FetchKeys
 2022-08-15 16:42:19 -05:00
Xiaoxi Wang a248ce965c
Merge pull request #7894 from sfc-gh-xwang/refactor/main/pointers 
Change trackerCancelled and shards in DDTracker to pointer
 2022-08-15 14:06:39 -07:00
Bala Namasivayam 03382c6267 Fix ErrorCommitInfo event parser 2022-08-15 13:22:17 -07:00
Xiaoxi Wang 411e0e4bff
Merge pull request #7893 from sfc-gh-xwang/refactor/main/pollMoveKeysLock 
Move pollMoveKeysLock method to DDTxnProcessor
 2022-08-15 13:15:18 -07:00
Markus Pilman 072c10ed44
Merge pull request #7823 from sfc-gh-anoyes/anoyes/improve-determinism 
Improve determinism (based on JOSHUA_SEED)
 2022-08-15 14:09:49 -06:00
Xiaoxi Wang bbae301444 change trackerCancelled and shards in DDTracker to pointer 2022-08-15 13:03:47 -07:00
Markus Pilman eb16947860
Merge pull request #7844 from jzhou77/grv-error 
Buggify GRV proxy to return errors and fix bugs found
 2022-08-15 13:59:21 -06:00
Markus Pilman 18aa638951
Merge pull request #7877 from sfc-gh-mdvorsky/mdvorsky/fix_net2_unittest 
Fix Net2 unittest flakiness
 2022-08-15 13:58:40 -06:00
Xiaoxi Wang d26e62ea68 pollMoveKeysLock method to DDTxnProcessor 2022-08-15 12:09:16 -07:00
Steve Atherton f2f6148a47 Merge commit '03435b5133f6bcb7855bb8111012d0e752a60f11' into remove-fkreenablelb-spam 2022-08-15 11:55:02 -07:00
Ata E Husain Bohra 03435b5133
Update BlobCipher cache to respect EKP/KMS cipherKey TTL (#7885) 
Description

FDB native encryption data at-rest supports two type of cipher-keys
in-memory caching:
1. Revocable keys - with a definite expiry (future timestamp)
2. Non-revocable keys - with or without expiry timestamp and/or
refreshAt timestamp.

Patch update BlobCipherKey in-memory cache to respect EKP/KMS
supplied 'refreshAt' and 'expireAt' timestamp. GetLatestCipher
validates `cipher key freshness' as well as GetCipherKey checks
for 'cipher key liveness' before replying details to the caller.

Patch also optimizes the BlobCipher module logging by taking
following measures:
1. BLOB_CIPHER_DEBUG macro to guard spammy log messages needed
mostly for debugging failures.
2. Minimize log volume by logging cipherKey details for any new
key added to the cache, key-refreshes are not logged.
3. Categorize logs into: debug, info and warn on per-usecase basis

Testing

devRunCorrectness - 100K
EncryptOps.toml - 100K
 2022-08-15 11:17:26 -07:00
Chaoguang Lin 3fed0456ca
Add an verify option for \xff\xff/worker_interfaces special keys (#7873) 
* Add the verify option for \xff\xff/worker_interfaces

* Remove unused code

* update documentations

* update documentations

* solve comments from review

* update some of the comments to be more clear
 2022-08-15 14:05:07 -04:00
Josh Slocum 2d7a7d7273
Merge pull request #7890 from apple/main 
Re-cut snowflake/release-71.2
 2022-08-15 12:57:19 -05:00
Xiaoxi Wang 1a7f6090b9
Merge branch 'main' into refactor/main/enableState 2022-08-15 10:55:20 -07:00
Dan Adkins 4317e528ab
Guard initPersistentState() calls with timeout. (#7649) 
We've observed the recovery process stuck in initPersistentState,
while waiting to acquire persistentDataCommitLock. All of the
other places in that function which potentially interact with a
disk are guarded by a timeout: TLOG_MAX_CREATE_DURATION.

Since it's possible that the current holder of that lock is
stuck in persistentData->commit(), it makes sense to add
a timeout around the entire function, rather than each of the
places where it might get stuck on an I/O operation.

The end result is that after 10 seconds, this process will fail
and cluster recovery will restart.
 2022-08-15 10:02:03 -07:00
Jingyu Zhou 120140b8b1
Merge pull request #7857 from yao-xiao-github/perf-metrics 
Fix metrics and add tunable knobs.
 2022-08-15 09:30:25 -07:00
Jingyu Zhou 19e61b9a9c
Merge pull request #7878 from sfc-gh-mdvorsky/mdvorsky/fix_global_tag_throttler_ubsan 
Fix uninitialized bool values in GlobalTagThrottler
 2022-08-15 09:28:09 -07:00
Jingyu Zhou 656caf7cbd
Merge pull request #7887 from sfc-gh-satherton/redwood-oversize-root 
Support arbitrarily large root nodes in Redwood
 2022-08-15 09:25:07 -07:00
Vaidas Gasiunas f04ab582dd
Add documentation for API Tester (#7869) 
* Add documentation for API Tester

* API Tester documentation: addressing review comments
 2022-08-15 15:10:15 +02:00
Steve Atherton d6d2c3a78c Merge commit 'c387e140cde1249d8c7bffdf9b0d19da85a3971d' into redwood-oversize-root 2022-08-15 03:59:41 -07:00
Vaidas Gasiunas c387e140cd
Test more C API in upgrade tests (#7853) 
* Test more C API in upgrade tests

* Fix saving results in blob granule API correctness test

* Enable multitenancy in upgrade test with API version >=720

* Disable the upgrade test with blob granule workload
 2022-08-15 11:08:53 +02:00
Mohamed Oulmahdi 7d03ce1add
Merge pull request #7884 from Doxense/7682-fix-windows-build 
7682 - Fix Windows build
 2022-08-15 10:41:03 +02:00
Steve Atherton dfd71df6f7 Re-enable use of Redwood in BlobGranule tests. 2022-08-15 00:19:09 -07:00
Steve Atherton a5bb723550 Remove effective root pointer size limit by building additional root levels until the pointer is small enough to fit in the commit record. 2022-08-15 00:10:55 -07:00
Mohamed Oulmahdi 7824de5ff4 Fix Windows build broken by #7682 2022-08-15 05:02:46 +02:00
A.J. Beamon ae1fc191f1
Merge pull request #7881 from sfc-gh-ajbeamon/metacluster-restore-prep 
Metacluster restore preparation
 2022-08-14 11:00:07 -07:00
Steve Atherton 9ac75c5cdd Remove extremely spammy trace event by only logging the re-enabling of load balance in FetchKeys if it was disabled. 2022-08-13 13:04:59 -07:00