wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
24,540 Commits 32 Branches 308 Tags 272 MiB
Commit Graph

24540 Commits

Author SHA1 Message Date
Junhyun Shim 09a159d140 Clean up log messages 2023-01-12 18:48:59 +01:00
Vaidas Gasiunas 962cd6efcd get_client_status: determine the health status 2023-01-12 18:46:04 +01:00
A.J. Beamon 281083822b Trigger a commit if none happens within some amount of time when a tenant lookup is performed 2023-01-12 09:11:30 -08:00
Jingyu Zhou aeb0437411
Merge pull request #9069 from iClaus21/fdb-go-freebsd-binding 
Add Golang binding for FreeBSD
 2023-01-12 08:47:29 -08:00
Vaidas Gasiunas 205466e04c get_client_report: report storage servers 2023-01-12 15:15:07 +01:00
Zhe Wu 37e026366c
Merge pull request #9119 from halfprice/zhewu/add-txn-server-initialization-event-1 
Add event for txn server initialization and a warning for TLog slow catching up
 2023-01-11 22:00:53 -08:00
Zhe Wu 359b3a11e7 Change TLog pull async data warning timeout 2023-01-11 19:36:00 -08:00
Junhyun Shim e3a1e8dd24 Fix retry loop in blobbifyRange on tenants 
Also fix missing cluster_file in BatchDeleteTenantRequest::serialize()
 2023-01-12 02:01:40 +01:00
Xiaoxi Wang 9efba1f5e6 clearify the return type 2023-01-11 15:58:16 -08:00
Nim Wijetunga 1675502d76
Blob Worker Encryption doesn't use BG_METADATA_SOURCE (#9121) 
* bw encrypt doesnt use knob

* Trigger Build
 2023-01-11 14:03:25 -08:00
A.J. Beamon ac2a26d269
Merge pull request #9070 from sfc-gh-ajbeamon/fix-invalid-json-access 
Fix incorrect JSON access of blob metadata partitions in REST KMS test
 2023-01-11 12:24:48 -08:00
Mohamed Oulmahdi dcea8a0ac7 Restart joshua 2023-01-11 12:12:16 -06:00
Mohamed Oulmahdi b2eba6956c Add tokensign dependency for Windows 2023-01-11 12:12:16 -06:00
sfc-gh-tclinkenbeard 5a1a969343 Trace data hall id in MachineMetrics events 2023-01-11 10:02:31 -08:00
Zhe Wu 087d37d10b Add event for txn server initialization and a warning for TLog slow catching up 2023-01-11 10:02:06 -08:00
Xiaoxi Wang 6592ecc3a5 merge upstream/main; confliction solve 2023-01-11 09:33:21 -08:00
Xiaoxi Wang 09b0e639bf fix assertion error 2023-01-11 09:21:51 -08:00
Vaidas Gasiunas 8d734fba85 get_client_status: report database connection status 2023-01-11 17:43:35 +01:00
Xiaoxi Wang 229565c791 check SetVersionstampedKey offset 2023-01-10 23:58:51 -08:00
Xiaoxi Wang c9aa3f1458 toml file format 2023-01-10 23:13:55 -08:00
Nim Wijetunga 114eb4a3a6
Resolver uses Encryption DB Config (#9002) 
Resolver uses encryption DB config
 2023-01-10 17:11:14 -08:00
Xiaoxi Wang 3bcb55dccb
Apply suggestions from code review 
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
 2023-01-10 16:57:54 -08:00
Hui Liu 981bced0fc
Merge pull request #9094 from sfc-gh-huliu/blobrestore 
Run Cycle check for BlobRestoreBasic.toml
 2023-01-10 15:07:24 -08:00
Hui Liu 4af55a274d Add data verification at the end of BlobRestoreBasic.toml 2023-01-10 13:26:36 -08:00
Vaidas Gasiunas 265c8f7f78 get_client_status: Fix compiler warning 2023-01-10 14:31:04 +01:00
Yi Wu 0849f60ef1
Clean up cluster controller's wait on recoveredDiskFiles (#9105) 
The `recoveredDiskFiles` is a promise that will be fulfilled once all the local TLog and storage files have been initialized in a process. It was added previously to make a process wait on it before joining the cluster, and it was to avoid a slow recovering TLog to join the cluster to slowdown cluster recovery. 

With #7510, we allow a process to join the cluster to play stateless role, while still avoid it to join the cluster as stateful role before its TLog and storage is recovered. As such, the `recoveredDiskFiles` wait is no longer needed. This PR cleanup the logic.
 2023-01-09 16:26:32 -08:00
Yi Wu 97d810cdba
TestHarness2: fix reproduce command missing --restarting param (#9111) 
Fix restart test command missing --restarting params.
 2023-01-09 16:24:25 -08:00
Jingyu Zhou bfdf566b68
Merge pull request #9098 from jzhou77/fix 
Remove dangerous label for streaming knobs
 2023-01-09 13:51:58 -08:00
Xiaoxi Wang 50217e7172 update workload checking because watch retry 2023-01-09 13:35:21 -08:00
Xiaoxi Wang c00c631ffb Merge branch 'main' of https://github.com/apple/foundationdb into feature/main/watchTenant 2023-01-09 13:26:06 -08:00
Ata E Husain Bohra f673fce975
[EaR]: Update KMS APIs to split encryption keys endpoints (#9017) 
* [EaR]: Update KMS APIs to split encryption keys endpoints

Description
  diff-1: Address review comments

Major changes proposed:
1. Extend fdbserver to allow parsing two endpoints for encryption at-rest
support: getEncrypitonKeys, getLatestEncryptionKeys
2. Update RESTKmsConnector to do the following:
 2.1. Split the getLatest and getCipher requests.
 2.2. "domain_id" for point lookup marked as 'optional'

Testing

devRunCorrectness - 100K
 2023-01-09 10:55:53 -08:00
Vaidas Gasiunas 6162fc333c get_client_status: Provide more MVC database status info, test client versions 2023-01-09 19:36:39 +01:00
Nim Wijetunga d4cbe20d5f
Cluster Controller uses DB Config (#8992) 
CC uses db config for encryption
 2023-01-09 12:17:36 -05:00
Jingyu Zhou c07c511395
Merge pull request #9104 from sfc-gh-anoyes/anoyes/fix-etc-foundationdb 
Fix /etc/foundationdb ownership for RPM
 2023-01-09 09:10:13 -08:00
Evan Tschannen 9c4384a6d9
Merge pull request #5102 from sfc-gh-ljoswiak/fixes/thrashing-recoveries 
Fix issue where recoveries could thrash between regions
 2023-01-09 08:53:46 -08:00
Vaidas Gasiunas f14f2ccc0d Introducing API function get_client_status; Exposing and testing database initialization state 2023-01-09 16:09:58 +01:00
Xiaoxi Wang 72597f7db6 format code; refactor tenant management workload setup; use fmt::print 2023-01-07 19:43:10 -08:00
Xiaoxi Wang 07bd4c311b solve merge conflict 2023-01-06 16:39:40 -08:00
Xiaoxi Wang 5bf999cf21 check SetVersionstampedKey 2023-01-06 16:35:07 -08:00
Andrew Noyes ad6362b2f1 Fix /etc/foundationdb/ rpm ownership 2023-01-06 16:30:18 -08:00
Xiaoxi Wang b3886806c4 modify tests configuration 2023-01-06 16:01:24 -08:00
Yi Wu 845cc62a39
Redwood: fix tree height overgrowth with per-tenant encryption (#9020) 
* Fix Redwood tree height overgrowth when EaR and tenant page split are enabled, by removing the buildNewSubtree() logic.
* Fixing incorrect page upper bound for the last page created by writePages() without the buildNewSubtree() logic.
* Enable tenant page split if encryption mode is domain-aware encryption.
* Related test fixes:
  - In simulation, pass encryption mode to storage/Redwood via knobs. This is a workaround to enable testing with Redwood encryption before we correctly pass the encryption mode via db config. Also temporarily disable tenant page split for restart tests.
  - Disable raw access in FuzzApiCorrectness test if domain-aware encryption is enabled, to avoid test timeout
  - Disable encryption for DrUpgradeRestart test, which is likely to fail due to a rare EKP deadlock issue blocking recovery. Will re-enable after the deadlock issue is fixed.
 2023-01-06 15:56:37 -08:00
Xiaoxi Wang ef17634174 change watchCheck to coinflip; rename noDestroy 2023-01-06 15:56:22 -08:00
A.J. Beamon f999623bb1 Add a tenant lookup interface and use it when starting transactions 2023-01-06 15:51:12 -08:00
Xiaoxi Wang f049c3d74d rewrite watch check 2023-01-06 15:45:56 -08:00
A.J. Beamon 05bbb7c840
Merge pull request #9015 from sfc-gh-ajbeamon/expand-optional-erroror-map 
Add overloads of the Optional::map and ErrorOr::map functions that allow easy member access
 2023-01-06 15:44:15 -08:00
Lukas Joswiak e2752aea05 Fix issue where recoveries could thrash between regions 2023-01-06 15:20:30 -08:00
A.J. Beamon a5f882c0ac Merge branch 'main' into expand-optional-erroror-map 2023-01-06 14:29:50 -08:00
Jingyu Zhou d1e5018f60 Merge remote-tracking branch 'apple/main' into fix 2023-01-06 14:16:28 -08:00
Nim Wijetunga 10ccaa1ee5
remove client info encryption state (#9096) 2023-01-06 17:14:06 -05:00