wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
25,680 Commits 34 Branches 312 Tags 239 MiB
Commit Graph

25680 Commits

Author SHA1 Message Date
Markus Pilman 2adc824b0a Fix comparison 2023-03-07 07:25:05 -07:00
Markus Pilman c6d0b920b0 Improve contract of ProcessEvents 2023-03-07 07:15:04 -07:00
Steve Atherton 5ff0bc3f87
Merge pull request #9576 from sfc-gh-satherton/storage-configure-refactor 
Storage and log engine configuration support / refactor a few things.
 2023-03-07 02:10:14 -08:00
Steve Atherton 77f626194d Remove duplicate if block. 2023-03-07 00:02:42 -08:00
Xiaoxi Wang 41d01629f1 change IndexSet::addMetrics return type to pair<metrics, iterator> to reduce another find call 2023-03-06 22:23:55 -08:00
Jingyu Zhou 7c54cc823b Require at least 2 regions and having satellites 2023-03-06 20:31:28 -08:00
Jingyu Zhou 31a051b1f1 Enable DcLag test 2023-03-06 19:04:24 -08:00
Steve Atherton 3faff52266 Fix comment. 2023-03-06 18:44:58 -08:00
Steve Atherton f6747adf89 Move implementations to cpp file. 2023-03-06 18:43:26 -08:00
Jingyu Zhou 0259a243ae Switch DC if log router peek becomes stuck 
Trying to a different DC if this happens.
 2023-03-06 17:41:56 -08:00
Markus Pilman 7eaf999644 reverting testing code 2023-03-06 17:38:41 -07:00
Markus Pilman 0838bfcfa2 Allow workloads to log errors when test times out 2023-03-06 17:36:26 -07:00
Ata E Husain Bohra a45de70003
EaR: RESTClient HTTP compliance, fix json request content type (#9544) 
* EaR: RESTClient HTTP compliance, fix json request content type

Description

  diff-1: Address review comments

RESTClient is responsible to handle FDB <-> KMS communication
for Encryption and other usecases. By design, it only supports
"secure connection" i.e. "https"; however, it seems there is a
need to expand the module to support "http" connection,
for instance: test and dev deployments for instance.

However, given RESTClient gets involved in handling high
sensitive contents such as: plaintext "encryption cipher
from a KMS", the feature is guarded using
CLIENT_KNOB->REST_KMS_ENABLE_NOT_SECURE_CONNECTION which is
settable using FDBServer command line argument
"--kms-rest-enable_not_secure_connection" (boolean)

Testing

Deployed a standalone fdbserver and communicate with a
simple "http" server
 2023-03-06 16:06:03 -08:00
Jingyu Zhou 0d8bde9dcd
Merge pull request #9505 from jzhou77/fix 
Support multiple key prefix filters for fdbdecode
 2023-03-06 15:57:03 -08:00
Jingyu Zhou 1cb4070252 Refactor LogRouter's pullAsyncData 2023-03-06 15:45:46 -08:00
Jingyu Zhou c5d123ee66 Ignore the DcLag test 2023-03-06 15:43:06 -08:00
Jingyu Zhou 64876234d5 Add disableSimSpeedup to clog network longer 2023-03-06 15:40:47 -08:00
Jingyu Zhou b8357263a4 Add DcLag tests and workload 2023-03-06 15:40:47 -08:00
Xiaoxi Wang 272fa49638 Merge branch 'main' of https://github.com/apple/foundationdb into fix/main/sampleCopy 2023-03-06 15:04:02 -08:00
Chaoguang Lin 7273723a43
Add the hotrange fdbcli command (#9570) 
* Add the hotrange fdbcli command

* Remove the unnecessary state

* Add the doc about the hotrange command
 2023-03-06 14:46:52 -08:00
Jon Fu 9313e5f653 fix fdbcli segfault 2023-03-06 14:18:46 -08:00
Jingyu Zhou 7a0b3c05b9
Merge pull request #9540 from sfc-gh-huliu/timestamp 
Report restore phase start time and eta
 2023-03-06 14:06:23 -08:00
Jingyu Zhou 94a9e37583
Merge pull request #9526 from sfc-gh-xwang/fix/main/killall 
wait extra time to make sure rebootWorker request sent to storage server
 2023-03-06 11:25:09 -08:00
Steve Atherton 9e59474120
Merge pull request #9577 from sfc-gh-satherton/redwood-atomic-create 
Partially initialized Redwood files will no longer be reopened from disk
 2023-03-06 10:30:17 -08:00
A.J. Beamon 85c3cf702c
Merge pull request #9584 from sfc-gh-ajbeamon/fix-metacluster-create-error-msg 
Fix metacluster create error message
 2023-03-06 10:30:03 -08:00
Jingyu Zhou d7340cbaa1
Merge pull request #9533 from sfc-gh-clin/remove-time-guard-check-on-fdbcli-tests 
Remove the time guard on fdbcli commands in tests
 2023-03-06 10:22:49 -08:00
Jingyu Zhou 211d416f25
Merge pull request #9568 from sfc-gh-jslocum/even_more_bg_fixes 
Even more bg fixes
 2023-03-06 09:35:39 -08:00
Jingyu Zhou dd72be1e40
Merge pull request #9551 from sfc-gh-jslocum/bg_latency_fixes 
Bg latency fixes
 2023-03-06 09:34:54 -08:00
Jingyu Zhou 179a9eed79
Merge pull request #9555 from kakaiu/fix-dd-audit-storage-early-start 
Fix race between auditStorage and resumeAuditStorage
 2023-03-06 09:32:26 -08:00
A.J. Beamon ea907f10f5 Print the tenant mode string rather than integer value when reporting that we couldn't create a metacluster 2023-03-06 09:25:50 -08:00
Josh Slocum 9b3990fa0d Merge branch 'main' into even_more_bg_fixes 2023-03-06 09:23:32 -06:00
Josh Slocum e1b620135b Merge branch 'main' into bg_latency_fixes 2023-03-06 09:23:11 -06:00
Junhyun Shim a2a29af56e
Temporarily disable client trace check for older version (#9578) 
* Disable client trace check test on older version

Older version doesn't guarantee trace flush upon network::stop()
Comment it out for the time being

* Black-reformat authz and client config tester scripts
 2023-03-06 15:36:28 +01:00
Xiaoxi Wang fe58928e6b Merge branch 'main' of https://github.com/apple/foundationdb into fix/main/sampleCopy 2023-03-05 14:27:25 -08:00
Steve Atherton 08afc90081 Partially initialized Redwood files will no longer be seen and reopened on disk via the "atomic write and create" file option and delaying the first sync on a new file until it would be recoverable the first commit() initiated by the user. 2023-03-05 12:15:47 -08:00
Steve Atherton 50d567b5a5 Refactored some parts of database configuration to support log_engine=<name> and storage_engine=<name> and generate these when converting a DatabaseConfig JSON object to a `configure` command. Refactored `fileconfigure` and simulation setup to use the same JSON -> configure function as the same code was copy/pasted to both places but only one has been kept up to date with new features. Renamed Redwood to `ssd-redwood-1` canonically but the experimental name is still supported for backward compatibility. 2023-03-04 20:52:31 -08:00
Jingyu Zhou 9cbf5c8f0e
Merge pull request #9320 from apple/dependabot/pip/tests/TestRunner/cryptography-39.0.1 
Bump cryptography from 38.0.3 to 39.0.1 in /tests/TestRunner
 2023-03-04 16:34:09 -08:00
Jingyu Zhou 99edf5c2c8
Merge pull request #9321 from apple/dependabot/pip/tests/authorization/cryptography-39.0.1 
Bump cryptography from 38.0.3 to 39.0.1 in /tests/authorization
 2023-03-04 16:33:26 -08:00
Jingyu Zhou cb1af6e520
Merge pull request #9454 from apple/dependabot/go_modules/fdbkubernetesmonitor/golang.org/x/text-0.3.8 
Bump golang.org/x/text from 0.3.7 to 0.3.8 in /fdbkubernetesmonitor
 2023-03-04 16:31:16 -08:00
Steve Atherton 1dd414cc0f
Merge pull request #9554 from sfc-gh-satherton/redwood-queue-error-handling 
Avoid broken_promise in Redwood before shutdown after queue read error.
 2023-03-04 12:53:49 -08:00
Steve Atherton 1b01c1b76c Merge commit '53a3744de729639ec2d8ad7ba8ee899355a8f28d' into redwood-queue-error-handling 2023-03-04 03:29:36 -08:00
Jingyu Zhou df53bcd844 Merge branch 'main' of https://github.com/apple/foundationdb into fix 2023-03-03 20:32:29 -08:00
Jingyu Zhou 53a3744de7
Merge pull request #9569 from ammolitor/fix_flowbench 
update target_link with new path from build image
 2023-03-03 20:31:43 -08:00
Hui Liu b2d497a3b2 Report restore phase start timestamp 2023-03-03 18:09:51 -08:00
Xiaoxi Wang 303791a060 change parameter type from KeyRef to Key to avoid extra copy in sampler 2023-03-03 15:37:45 -08:00
Jingyu Zhou 8847e70be0
Merge pull request #9306 from kakaiu/add-physical-shard-meta-data-to-checkpoint 
Dump checkpoint metadata to sst file
 2023-03-03 14:45:50 -08:00
Aaron Molitor 7cadc5420e update target_link with new path from build image 2023-03-03 16:30:07 -06:00
Josh Slocum d80967e4ca fixing leaked BW future that can cause worker to hang on shutdown if BW has an IKVS 2023-03-03 13:57:57 -06:00
Josh Slocum 526134f598 review comments 2023-03-03 13:52:59 -06:00
Jingyu Zhou ca00c9485b Merge branch 'main' of https://github.com/apple/foundationdb into fix 2023-03-03 11:12:40 -08:00