Commit Graph

20539 Commits

Author SHA1 Message Date
Josh Slocum 567b1d35f7 Full integration with BlobConnectionProvider for blob granules 2022-06-01 12:39:51 -05:00
Josh Slocum ffa4255c65 Added blob metadata concept as new secret type, and verified blob workers can load it 2022-05-27 15:15:56 -05:00
Renxuan Wang cd2a575e02
Move the resolve of coordinator hostname from getCoordinatorProtocol() to getClusterProtocolImpl(). (#7245)
* Move the resolve of coordinator hostname from getCoordinatorProtocol() to getClusterProtocolImpl().

* Guard DNS Cache behind a knob.
2022-05-26 09:45:54 -07:00
Josh Slocum 458e8018e1 review comments 2022-05-25 17:16:56 -05:00
Josh Slocum 5621fcff40 formatting fix 2022-05-25 17:16:56 -05:00
Josh Slocum fd7b662767 cleaning up 2022-05-25 17:16:56 -05:00
Josh Slocum dd637dd6a7 passes tenant simulation test 2022-05-25 17:16:56 -05:00
Josh Slocum e3a570d50d Blob worker tenant integration mostly works 2022-05-25 17:16:56 -05:00
Josh Slocum 85af0a25b2 Enabling BM to understand tenant boundaries, and changing BlobGranuleCorrectness to use tenants 2022-05-25 17:16:56 -05:00
Josh Slocum 49b50ae8b0 Disabling default tenant in blob granule tests 2022-05-25 17:16:56 -05:00
Josh Slocum ad54be5d0b Enabling tenant tests for blob granules and fixing bug 2022-05-25 17:16:56 -05:00
Jingyu Zhou 47f2118cb0 Update 7.1.6 and 7.1.7 release notes. 2022-05-25 13:30:48 -07:00
Andrew Noyes 6f500b59c0
Fix a heap-use-after-free in PaxosConfigConsumer.actor.cpp (#7244)
* Fix a heap-use-after-free in PaxosConfigConsumer.actor.cpp

* Two more defensive local promises

* Two more defensive promise copies

* Fix latent logic error
2022-05-25 12:08:30 -07:00
A.J. Beamon 18bd518f6e
Merge pull request #7239 from xis19/main
Fix the test failure in Tenant.cpp
2022-05-25 09:56:30 -07:00
Zhanwei Wang da346d718f Fix compatibility issue of s3 backup
1. For v4 signature, http request path should be encoded, currently only parameters are encoded.
2. For v2 signature, http request date header should be in form of either the http date header or x-amz-date, currently in form of ISO 8601
3. Empty response header value cause http_bad_response error.
4. Skip verifying MD5 for range get request and if http response code 206 is returned.
2022-05-25 09:48:54 -05:00
Jingyu Zhou 75e9774197
Merge pull request #7236 from sfc-gh-anoyes/anoyes/revert-5637-main
Revert most logic in #5637
2022-05-24 18:00:37 -07:00
Xiaoge Su 337ea89ae8 fixup! Fix the test failure in fdbclient/Tenants.cpp 2022-05-24 17:24:23 -07:00
Andrew Noyes 665e903999
Fix use of uninitialized memory (#7231)
We branch on the value of cf, so we need to initialize it.
2022-05-24 14:58:08 -07:00
Andrew Noyes 53882ef741 Revert most logic in #5637 2022-05-24 12:23:49 -07:00
Xiaoxi Wang 8b0f53caf1
Merge pull request #7209 from sfc-gh-xwang/features/debug-macro
Add DebugLogTraceEvent
2022-05-24 10:36:42 -07:00
Xiaoxi Wang 4cbec5c742
Merge branch 'apple:main' into features/debug-macro 2022-05-24 09:12:39 -07:00
Zhe Wu cb73352e36 Don't pop every generation of old log router 2022-05-24 08:47:57 -07:00
Yao Xiao 6bf1e3921f
Add skeleton for sharded rocksdb KVS. (#7181) 2022-05-23 15:29:23 -07:00
Xiaoxi Wang 0be1369d39
Merge pull request #7225 from sfc-gh-xwang/fix/remove-reference-count
Remove extra ReferenceCounted inheritance
2022-05-23 14:52:27 -07:00
Xiaoxi Wang bda65b95ad update header 2022-05-23 14:50:45 -07:00
sfc-gh-tclinkenbeard 8194460915 Update is_unknown_knob in test_argument_parsing.py 2022-05-23 13:41:48 -07:00
sfc-gh-tclinkenbeard 1cc9a5284c Avoid printing warnings in LocalConfiguration::ManualKnobOverrides constructor 2022-05-23 13:41:48 -07:00
Trevor Clinkenbeard 3cbc3e0e9b Removed unnecessary apostrophe
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2022-05-23 13:41:48 -07:00
sfc-gh-tclinkenbeard f199f5f7a5 Process should not crash when given invalid knob name 2022-05-23 13:41:48 -07:00
A.J. Beamon 804bd8d3e2 Remove documentation of the tenant prefix configuration key. 2022-05-23 13:28:40 -07:00
Xiaoxi Wang 5fdf9f99d4 Merge branch 'fix/remove-reference-count' of github.com:sfc-gh-xwang/foundationdb into fix/remove-reference-count 2022-05-23 13:00:36 -07:00
Xiaoxi Wang 15219677aa remove extra reference count inheritance 2022-05-23 13:00:31 -07:00
Lukas Joswiak d4471e7fe7 Disable `advanceversion` if the version epoch is set
If the version is attempting to track wall clock time (which is the case
if the version epoch is set), it doesn't make sense to allow arbitrarily
setting the version through the `advanceversion` fdbcli command.
2022-05-23 11:45:18 -07:00
Lukas Joswiak 619c056f17 Add unit tests for reference version function
Factors the updated version calculation path into a function and adds
unit tests for it. Some of the important test paths include making sure
the calculated version always increases, and to check issues with
overflowing integers.
2022-05-23 11:45:18 -07:00
Lukas Joswiak 18f80256b0 Add versionepoch fdbcli tests
Also removes the old targetversion fdbcli tests, as this command has
been removed (at least for now).
2022-05-23 11:45:18 -07:00
Lukas Joswiak 475b157310 Add `get` command to versionepoch help text 2022-05-23 11:45:18 -07:00
Renxuan Wang df4e0deb4d
coordinatorsKey should not always store IP addresses. (#7204)
* coordinatorsKey should not storing IP addresses.

Currently, when we do a commit of coordinator change, we are always converting hostnames to IP addresses and store the converted results in coordinatorsKey (\xff/coordinators). This result in ForwardRequest also sending IP addresses, and receivers will update their cluster files with IPs, then we lose the dynamic IP feature.

* Remove the legacy coordinators() function.

* Update async_resolve().

ip::basic_resolver::async_resolve(const query & q, ResolveHandler && handler) is deprecated.

* Clean code format.

* Fix typo.

* Remove SpecifiedQuorumChange and NoQuorumChange.
2022-05-23 11:42:56 -07:00
Josh Slocum 4015b5b2a0
Several Blob Granule bug fixes found in nightlies (#7170)
* Fixing simulation validation assert that was tripping incorrectly

* Commenting out debugging prints

* Fixed multiple error propagation issues in blob worker
2022-05-23 10:07:16 -07:00
Junhyun Shim 02b2f97e99
mTLS test helpers (#7218)
* Add TLS option to (local_cluster|tmp_cluster).py

* Add TLS-enabled C API test
2022-05-23 12:47:51 +02:00
Steve Atherton c073f113a5
Explicitly cancel byte sample recovery on failure of a recovered storage server to prevent it from trying to read from the IKeyValueStore after shutdown. (#7212) 2022-05-20 19:55:52 -07:00
Kao Makino a9d62ea031
Merge pull request #7169 from sfc-gh-khoxha/main
Use correct transaction latency in async mako
2022-05-20 15:49:39 -07:00
Dan Lambright 5e5e454362
Merge pull request #7199 from apple/blocking-peek-is-1sec-bug 2022-05-20 17:34:56 -04:00
Dan Lambright 801f6d52ee put buggigy knob conditionals in standard format 2022-05-20 16:02:07 -04:00
Xiaoxi Wang 5a431980d2 Merge branch 'main' of https://github.com/apple/foundationdb into features/debug-macro 2022-05-20 12:18:20 -07:00
Xiaoxi Wang 6b996dca29 add debug macro 2022-05-20 12:17:45 -07:00
Chaoguang Lin 5e8c3130e6 Extend the reboot interface to accept comma-delimited string;
Only fetch requested worker interfaces in rebootWorkerActor
Add killall test to multiprocess_fdbcli_tests
Make the rebootWorker only sends requests if all the requested workers are valid
Add comments; Organize print texts; Fix the bug clear the map every time run kill/suspend/expensive_data_check
2022-05-20 12:06:33 -07:00
Hao Fu fc8d04b19d
Make java binding work for prefetch match index modes. (#7186)
* Make java binding work for prefetch match index modes.

It adds boundaryAndExist in return value, so that caller can see
whether a boundary index is orphan or not.

* Make Java code work with index match modes

* Add test for boundaryAndExist in java binding test
2022-05-20 09:10:02 -07:00
Ray Jenkins dcd771bd07
Use semicolon for consistency with all other spans. (#7201) 2022-05-20 10:18:00 -05:00
Ray Jenkins d1efc05a9b
Remove parentContext.traceID from MessagePack serialization. (#7197)
The OTEL receiver does not utilize the parent Trace id, only parent Span id. Essentially
it relies on Trace ids implicitly matching during trace assembly. Therefore, we may remove
these 16 bytes in serialization.
2022-05-19 16:43:06 -05:00
He Liu 78dc7c5d77 Resolving comments. 2022-05-19 13:27:21 -07:00