wbtiger
/
foundationdb
mirror of https://github.com/apple/foundationdb.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
20,815 Commits 34 Branches 312 Tags 293 MiB
Commit Graph

20815 Commits

Author SHA1 Message Date
A.J. Beamon 69261f9f10 Merge branch 'main' into feature-metacluster 
# Conflicts:
#	fdbclient/MultiVersionTransaction.actor.cpp
#	fdbclient/MultiVersionTransaction.h
#	fdbserver/tester.actor.cpp
 2022-05-19 09:11:30 -07:00
Trevor Clinkenbeard d7f0928a48
Merge pull request #7161 from sfc-gh-bvr/ddspruce 
Minor readability improvement (I believe) to DD code
 2022-05-19 08:45:22 -07:00
Dan Lambright a4fa68453c In version vector, blocking peek timeout cannot be much greater than max_read_transaction_life_versions 2022-05-19 10:34:37 -04:00
A.J. Beamon 993a79b42c
Restart protocol monitoring logic when we cycle the coordinator, even if its the same coordinator. Add some defensive code in case we fetch the protocol version for an absent peer. (#6397) 2022-05-19 10:00:23 +02:00
Xiaoxi Wang 6c11fc74ba add debug traces 2022-05-18 15:20:23 -07:00
A.J. Beamon 367e59dc33 Add support for getting tenant and cluster metadata in fdbcli in a JSON format 2022-05-18 14:53:25 -07:00
Jon Fu cdca68e26a only use tenant management prefix and default tenants to 0 in mako 2022-05-18 17:26:05 -04:00
Jon Fu 5a1c7f5c08 attempt to create fdb_api.cpp to separate static declaration 2022-05-18 17:16:30 -04:00
Xiaoxi Wang 7541fb9a25 address some review comments 2022-05-18 13:39:07 -07:00
Xiaoxi Wang 5355a31bda adjust team comparison inflight penalty 2022-05-18 13:21:06 -07:00
Jon Fu cc6620e9bb fix CI errors 2022-05-18 16:03:44 -04:00
Trevor Clinkenbeard b55b67641c
Fix -Wlogical-op-parentheses warning (#7190) 2022-05-18 12:31:43 -07:00
Hao Fu dcacb30688
Add missing secondary queries tests for index prefetch (#7185) 
* Add missing secondary queries tests for index prefetch

This change adds test for missing secondary queries for index prefetch,
in this case, MATCHED_ONLY mode would NOT return KV and UNMATCHED_ONLY
mode would return KV.

* remove default value for params
 2022-05-18 12:13:19 -07:00
Jon Fu 17c8b4b2a0 Initial mako changes introducing Tenant API and replacing transaction resets 2022-05-18 14:48:40 -04:00
A.J. Beamon 98c3813431 Refactor the register logic so that only two write transactions take place. The first is to the data cluster, the second to the management cluster. 2022-05-18 11:21:39 -07:00
Xiaoxi Wang 8adf38ba08 Merge branch 'main' of https://github.com/apple/foundationdb into readaware 2022-05-18 10:11:18 -07:00
Hao Fu f00606fd71
Enable MATCHED and UNMATCHED mode for index prefetch (#7162) 
* Enable MATCHED and UNMATCHED mode for index prefetch

MATCHED mode returns index entries whose secondary KVs are present,
UNMATCHED mode returns index entries whose secondary KVs are absent.

Note that the conflict read range of this txn is set in 2 steps:
* Set the conflict range for primary query according to request
* Set the conflict ranges for secondary queries according to responses.

As a result, conflicts of different match_index mode are taken care of.

* Fix c binding
 2022-05-18 09:16:28 -07:00
A.J. Beamon e8e26c9f7c Remove the internal special key-space mechanism (at least for now), instead relying on the local logic to implement the metacluster functions. Add ability to force remove a cluster. Improve idempotency of register operation. 2022-05-18 08:18:25 -07:00
Ata E Husain Bohra 728869466d
Update EncryptBaseCipher cache to be index using {baseCipherId, domainId} (#7183) 
Description

Major changes proposed in the patch includes:
1. Update EncryptKeyProxy EncyrptBaseCipherKeyId cache to be indexed
   using {encryptDomainId, baseCipherId} instead of only 'baseCipherId'
2. Enhance RESTKmsConnector 'error' tag to encapsulte: errorMessage
   and errorCode information

Testing

1. Updated EncyrptKeyProxy test
2. Updated RESTKmsConnector unit test
 2022-05-18 06:16:40 -07:00
Vaidas Gasiunas 5205b565ab
Upgrade Tests: Testing downgrade from 7.2 to 7.1 (#7179) 2022-05-18 11:59:29 +02:00
Xiaoxi Wang 48e7689cc4 restore knob value 2022-05-17 22:20:35 -07:00
Xiaoxi Wang dc03bd0a29
Merge pull request #7182 from sfc-gh-xwang/main 
remove duplicate recoveryCount++
 2022-05-17 16:20:51 -07:00
Xiaoxi Wang e109d14771 Merge branch 'main' into readaware 2022-05-17 14:49:31 -07:00
Xiaoxi Wang 8950822e36 add knobs; change knobs 2022-05-17 14:49:27 -07:00
Xiaoxi Wang 9b28b46a1d remove duplicate recoveryCount++ 2022-05-17 14:10:01 -07:00
Ray Jenkins 7594f5c0f9
Mako add distributed tracing client (#7180) 
* Add support for specifying distributed client tracer in Mako.

Introduces a new command line option --distributed_tracer_client. Defaults to disabled, user may specify
disabled, log_file, network_lossy, or sim_end.

Testing locally and verified with distributed tracing receiver. Note: We use a simple integer here
to denote tracer type rather directly using the TracerType enum in flow/Tracing.h. Including Tracing.h pulls in
FDBTypes.h and results in conflicts with several classes, including Database.
 2022-05-17 15:23:14 -05:00
Josh Slocum a43c98519d
Switching char* to std::string for ProcessInfo to have it own memory (valgrind errors) (#7176) 2022-05-17 12:41:04 -07:00
Vaidas Gasiunas 840786ced5
Merge pull request #7177 from sfc-gh-vgasiunas/vgasiunas-api-tester-verbose 
Api Tester: print workload progress statistics in regular time intervals
 2022-05-17 21:28:50 +02:00
Bharadwaj V.R f43edb6799
Merge branch 'apple:main' into ddspruce 2022-05-17 11:04:59 -07:00
Xiaoxi Wang 382f0fc4a2 merge upstream/main 2022-05-17 10:20:51 -07:00
Xiaoxi Wang f40a2a68fc add more statistics 2022-05-17 10:19:09 -07:00
Vaidas Gasiunas 9966e3f7f7 Api Tester: print workload progress statistics in regular time intervals 2022-05-17 17:35:01 +02:00
Xiaoxi Wang 3b241955e7 add more informative trace info 2022-05-16 21:25:56 -07:00
Xiaoxi Wang 8e2a78bf3c
Merge pull request #7087 from sfc-gh-xwang/features/read-skew 
Add SkewedReadWriteWorkload
 2022-05-16 16:13:57 -07:00
Kevin Hoxha 4e6265537a Add correct transaction latency in ResumableStateForRunWorkload::onTransactionSuccess() 2022-05-16 14:06:55 -07:00
Alec Grieser 940ca2c6b8
Merge pull request #7166 from imperatorx/keyarrayresult-add-getter 
Update KeyArrayResult.java
 2022-05-16 14:03:24 -07:00
A.J. Beamon ea57e11e3c
Merge pull request #7168 from sfc-gh-rjenkins/client_tmp_dir-unique-code 
client_tmp_dir needs a unique code in bindings.
 2022-05-16 14:00:43 -07:00
Jingyu Zhou b5ce29ee5f
Merge pull request #7143 from sfc-gh-anoyes/anoyes/use-libcoro-valgrind 
Use libcoro for valgrind
 2022-05-16 13:17:48 -07:00
Ray Jenkins 3edc3431fe Update go bindings. 2022-05-16 14:48:40 -05:00
A.J. Beamon 0cdf27a995
Merge pull request #7154 from sfc-gh-svemuri/metacluster-numtenants-status 
Add tenant information to status
 2022-05-16 12:42:37 -07:00
Ray Jenkins b0ea1a2ce8 client_tmp_dir needs a unique code in bindings. 
Duplicate code caused distributed_client_tracer to break.
 2022-05-16 13:41:30 -05:00
Xiaoxi Wang dc5d2bff06 make ratekeeper don't limit read rebalance 2022-05-16 11:38:38 -07:00
Sagar Vemuri 290b903825 Do not add tenant-info to json if it cannot be correctly determined 2022-05-16 11:30:03 -07:00
Xiaoxi Wang ef0d49eb93
Update tests/CMakeLists.txt 2022-05-16 11:13:18 -07:00
Sagar Vemuri 7a22a6ea82 Add a null pointer check for extra safety 2022-05-16 11:09:10 -07:00
Sagar Vemuri ebf11d5d48 Update schemas with the tenants information 2022-05-16 11:09:10 -07:00
Sagar Vemuri 7d785fe6ba Add number of tenants to status 2022-05-16 11:09:10 -07:00
imperatorx 5e01c171be
Update KeyArrayResult.java 
Add missing getter
 2022-05-16 20:02:36 +02:00
Clement Pang 89c5901228 make MappedKeyValue constructor public 2022-05-16 09:49:50 -07:00
Junhyun Shim 0d86a959c8
Merge pull request #7165 from sfc-gh-jshim/mtls-test-helpers 
Fix Mac build failing from boringssl
 2022-05-16 14:32:26 +02:00