Commit Graph

1623 Commits

Author SHA1 Message Date
A.J. Beamon 69261f9f10 Merge branch 'main' into feature-metacluster
# Conflicts:
#	fdbclient/MultiVersionTransaction.actor.cpp
#	fdbclient/MultiVersionTransaction.h
#	fdbserver/tester.actor.cpp
2022-05-19 09:11:30 -07:00
Hao Fu dcacb30688
Add missing secondary queries tests for index prefetch (#7185)
* Add missing secondary queries tests for index prefetch

This change adds test for missing secondary queries for index prefetch,
in this case, MATCHED_ONLY mode would NOT return KV and UNMATCHED_ONLY
mode would return KV.

* remove default value for params
2022-05-18 12:13:19 -07:00
Hao Fu f00606fd71
Enable MATCHED and UNMATCHED mode for index prefetch (#7162)
* Enable MATCHED and UNMATCHED mode for index prefetch

MATCHED mode returns index entries whose secondary KVs are present,
UNMATCHED mode returns index entries whose secondary KVs are absent.

Note that the conflict read range of this txn is set in 2 steps:
* Set the conflict range for primary query according to request
* Set the conflict ranges for secondary queries according to responses.

As a result, conflicts of different match_index mode are taken care of.

* Fix c binding
2022-05-18 09:16:28 -07:00
Vaidas Gasiunas 5205b565ab
Upgrade Tests: Testing downgrade from 7.2 to 7.1 (#7179) 2022-05-18 11:59:29 +02:00
Ray Jenkins 7594f5c0f9
Mako add distributed tracing client (#7180)
* Add support for specifying distributed client tracer in Mako.

Introduces a new command line option --distributed_tracer_client. Defaults to disabled, user may specify
disabled, log_file, network_lossy, or sim_end.

Testing locally and verified with distributed tracing receiver. Note: We use a simple integer here
to denote tracer type rather directly using the TracerType enum in flow/Tracing.h. Including Tracing.h pulls in
FDBTypes.h and results in conflicts with several classes, including Database.
2022-05-17 15:23:14 -05:00
Vaidas Gasiunas 9966e3f7f7 Api Tester: print workload progress statistics in regular time intervals 2022-05-17 17:35:01 +02:00
Alec Grieser 940ca2c6b8
Merge pull request #7166 from imperatorx/keyarrayresult-add-getter
Update KeyArrayResult.java
2022-05-16 14:03:24 -07:00
Ray Jenkins 3edc3431fe Update go bindings. 2022-05-16 14:48:40 -05:00
imperatorx 5e01c171be
Update KeyArrayResult.java
Add missing getter
2022-05-16 20:02:36 +02:00
Clement Pang 89c5901228 make MappedKeyValue constructor public 2022-05-16 09:49:50 -07:00
Vaidas Gasiunas 194d5d99e3
Merge pull request #7157 from sfc-gh-vgasiunas/vgasiunas-fix-upgrade-test
Restoring checks after each step in upgrade test
2022-05-16 09:12:22 +02:00
Hao Fu 853e6a346b
Optimization: support removing index conditionally (#7116) 2022-05-13 10:10:43 -07:00
Vaidas Gasiunas 7c9a213127 Upgrade Tests: removing failing downgrade test to 7.1 2022-05-13 11:47:57 +02:00
Markus Pilman 452315ee78
Build mockkms and add mockkms test (#7153) 2022-05-12 15:07:02 -07:00
Vaidas Gasiunas 1992898323 Add a regression test to upgrade from 7.1 to 7.2 and downgrade back 2022-05-12 15:34:03 +02:00
Vaidas Gasiunas c84e0b0d7a
Merge pull request #7085 from sfc-gh-vgasiunas/vgasiunas-cluster-wiggle-test
Cluster wiggle test
2022-05-11 13:06:33 +02:00
Markus Pilman 524365083d
Merge pull request #7106 from sfc-gh-ahusain/ahusain-fdb-mock-kms
FDB native MockKMS REST server implementation
2022-05-10 09:10:54 -07:00
Markus Pilman e1ab0f5c4d
Merge pull request #7086 from sfc-gh-vgasiunas/vgasiunas-upgrade-tests-71
Upgrade Tests: Including 7.1 into the upgrade paths
2022-05-10 09:09:55 -07:00
Hao Fu 968c2cad43
Reduce workload in CycleMultiClientIntegrationTest (#7100) 2022-05-09 11:48:45 -07:00
Ata E Husain Bohra d6e5549226 FDB native MockKMS REST server implementation - Golang
Description

Major changes include:
1. FDB native MockKMS REST server implementation - Golang based.
2. Implements "getEncryptionKeys" endpoint utilized by
   FDB RESTKmsConnector module.
3. Ability to inject faults to induce errors at various points
   during query execution

NextSteps:

Need to integrate MockKMS to FDB build system.

Testing

1. Implements mockkms_test.go module providing extensive test coverage
   for newly added code.
2. Postman based local testing.
2022-05-07 20:53:13 -07:00
A.J. Beamon 7c3b99f5bd Add support for connection to clusters via a connection string. Start work on multi-cluster operations with data cluster registration. 2022-05-06 09:53:53 -07:00
A.J. Beamon 68a46ca14d
Merge pull request #6852 from sfc-gh-jfu/jfu-list-tenants
Add listTenants commands to python and java bindings
2022-05-06 08:37:17 -07:00
Vaidas Gasiunas 27c0113305 Upgrade Tests: Including 7.1 into the upgrade paths 2022-05-06 15:21:57 +02:00
Vaidas Gasiunas fab8f35683 Cluster wiggle test 2022-05-06 15:00:40 +02:00
Vaidas Gasiunas 254da4d796
Merge pull request #7065 from sfc-gh-jslocum/arm_bg_fix
Fix for arm BG tests
2022-05-05 11:18:44 +02:00
Jon Fu c001d55c24 push tenant_list result as a packed tuple to stay consistent with other operations 2022-05-04 16:33:46 -04:00
Josh Slocum a7fdb42db8 Fix for arm BG tests 2022-05-04 14:54:16 -05:00
Jon Fu b5556c57f9 adjust instruction ordering in tenant_list api for binding tester 2022-05-04 13:59:19 -04:00
Jon Fu 9798e5fc83 Merge branch 'main' of github.com:apple/foundationdb into jfu-list-tenants 2022-05-04 12:49:43 -04:00
Jon Fu 96a35264b4 return tenant_list as one operation and validate with assertions 2022-05-04 12:48:48 -04:00
Hao Fu 97eb12381b
implement equals and hashCode in MappedKeyValue (#7041) 2022-05-03 12:24:26 -07:00
Hao Fu fa2e85f1d3
Add comment about getMappedRange parameters (#7044) 2022-05-02 15:17:14 -07:00
Rajiv Ranganath cf6e39af79 docs: add `GET_RANGE_SPLIT_POINTS`
Add `GET_RANGE_SPLIT_POINTS` instruction documentation.
2022-05-02 13:31:20 -07:00
Ray Jenkins dc9e782ccc
OpenTelemetry Tracing Perf Fixes (#6990) 2022-05-02 14:56:51 -05:00
Josh Slocum 57e1b487f1 Fixing ASAN alloc-dealloc-mismatch 2022-05-02 12:56:05 -05:00
Jon Fu ff216c2f57 add tenant list metadata to binding tester 2022-05-02 13:42:11 -04:00
Jon Fu d953b961b7 Merge branch 'main' of github.com:apple/foundationdb into jfu-list-tenants 2022-04-29 13:16:54 -04:00
Jon Fu 2afaf55a48 fixed some binding tests and split stack operation between key and value of tenant list 2022-04-29 13:16:04 -04:00
Josh Slocum 14e7738455 review comments 2022-04-27 16:08:00 -05:00
Josh Slocum 92da9d12d4 Improvements to fix 2022-04-27 16:08:00 -05:00
Josh Slocum 1bd72dc99e Allowing for blob granules to initialize at start of TesterBlobGranuleCorrectness 2022-04-27 16:08:00 -05:00
Vaidas Gasiunas 6f841446a5 API Tests: Enable client logs. Dump out the logs in case of an error 2022-04-27 10:02:20 -04:00
Vaidas Gasiunas d021b404ea ApiTester: Fix error code handing in case of a timeout 2022-04-27 10:02:20 -04:00
Junhyun Shim 1ee7702779
Merge pull request #6489 from sfc-gh-jshim/mako-cpp-async
Refactor Mako for C++ and add asynchronous execution support
2022-04-27 10:49:21 +02:00
Junhyun Shim 2f9506f5cd Introduce hard cap to latency sampling & apply clang format 2022-04-26 11:19:48 +02:00
Junhyun Shim 81211989f1 Disable new sample collection after first bad_alloc
- Add more info to --async_xacts description
- Clean up unused macro in fdb_api.hpp
2022-04-26 10:54:39 +02:00
Jon Fu a5e52c9450 Merge branch 'main' of github.com:apple/foundationdb into jfu-list-tenants 2022-04-25 14:56:20 -04:00
Ray Jenkins 1c5bf135d5
Revert "Migrate to OpenTelemetry tracing. (#6855)" (#6941)
This reverts commit 5df3bac110.
2022-04-25 09:29:56 -05:00
Junhyun Shim 81f9279db2 Fix GCC error about memset-ing atomic vars 2022-04-25 15:09:29 +02:00
Junhyun Shim d431a9f11b Wrap platform-specific PATH_MAX header in another 2022-04-25 13:53:05 +02:00