Commit Graph

2034 Commits

Author SHA1 Message Date
Markus Pilman 5bebb5b4aa
Merge pull request #9492 from sfc-gh-vgasiunas/vgasiunas-api-version-defs
Centralize definition of API Version for Java, Python and C API
2023-02-28 12:04:02 -07:00
Russell Sears 3453c1a7a1 remove dependency on xerrors by replacing deprecated call to "xerrors.As". This allows the golang build to run offline. (This is simpler than adding "go mod vendor" to the developer container build.) 2023-02-27 15:38:58 -06:00
Russell Sears d2af157189 Add support for using pre-packaged jemalloc, doctest_proj, and fix python support for old fdbserver binaries 2023-02-27 15:38:58 -06:00
Russell Sears d02118db67 Add support for using pre-downloaded junit dependencies 2023-02-27 15:38:58 -06:00
Vaidas Gasiunas 8a934c4f93 Fix comment in TestApiVersion 2023-02-27 18:30:50 +01:00
Vaidas Gasiunas e3b3bf9307 Fix formatting in TestApiVersion 2023-02-27 18:27:42 +01:00
Vaidas Gasiunas 83f76b60b9 Define the API version separately for the Java tests that are not executed as a part of the CI 2023-02-27 18:20:11 +01:00
Vaidas Gasiunas 8ddda99036 Fix name of FDB_USE_LATEST_BINDINGS_API_VERSION 2023-02-27 16:53:35 +01:00
Vaidas Gasiunas ddb183e18b Fixing bindingtester 2023-02-27 16:46:01 +01:00
Vaidas Gasiunas ba726fac87 Replace hardcoded API version checks for 720 and 730 2023-02-27 16:18:01 +01:00
Vaidas Gasiunas 1b6ced1a09 Define latest C API version in one place 2023-02-27 15:13:56 +01:00
Vaidas Gasiunas f7e2f0b6ce Define latest python binding API version in one place 2023-02-27 13:12:10 +01:00
Vaidas Gasiunas 7f35b395d3 Define the latest Java bindings API version in one place 2023-02-27 11:53:01 +01:00
Vaidas Gasiunas 402f618180
Default transaction options for report_conflicting_keys and used_during_commit_protection_disable (#9441)
* Introducing default transaction options for report_conflicting_keys and used_during_commit_protection_disable, set the latter option always in Java bindings

* Reformatting TransactionIntegrationTest.java

* Update description of transaction_report_conflicting_keys option

* Remove dependency between mock and real database implementation in RangeQueryTest.java

* Update generated.go after changing desciption of an option

* Small improvements of the TransactionIntegrationTest code
2023-02-23 18:05:01 +01:00
Steve Atherton 23df46773d
Merge pull request #9422 from sfc-gh-satherton/client-read-options
Add transaction option definitions for read priority and read cache
2023-02-22 09:00:25 -08:00
Jingyu Zhou 9a8c346d1a
Merge pull request #9439 from sfc-gh-vgasiunas/vgasiunas-fix-java-getclientstatus-test
Fix Java GetClientStatusIntegrationTest
2023-02-22 08:58:56 -08:00
Josh Slocum bf97c3dbce
adding java tenant blob management test and fixing bug it found (#9428) 2023-02-22 10:52:26 -06:00
Vaidas Gasiunas cd0696e1cd Fix Java GetClientStatus integration test by wait on the future 2023-02-22 12:46:26 +01:00
Steve Atherton 806cef8f2d Update generated.go to reflect new options. 2023-02-22 00:32:08 -08:00
Josh Slocum 958f3b531b
Plumbing blob worker mapping through commit proxy like storage server (#9401)
* Plumbing blob worker mapping through commit proxy like storage server mapping

* review comments

* formatting
2023-02-21 13:21:44 -06:00
sfc-gh-tclinkenbeard 398079db3a Merge remote-tracking branch 'origin/main' into expose-tag-throttled-duration 2023-02-20 17:54:06 -08:00
Josh Slocum bfb3ffc509
added c and java apis for granule flush (#9412) 2023-02-20 10:28:11 -06:00
Vaidas Gasiunas 175307a590
Fix determinism in the generated bindingtester API tests (#9420)
* Reformat bindingtester api test generator with black

* Fix determinism in the generated bindingtester API tests
2023-02-20 15:58:51 +01:00
sfc-gh-tclinkenbeard 1aef6cb5f7 Merge remote-tracking branch 'origin/main' into expose-tag-throttled-duration 2023-02-17 20:41:59 -08:00
Josh Slocum 6c2fb13173
adding wait parameter to blobbify api (#9360)
* adding wait parameter to blobbify api

* formatting

* fixing comment style

* fixing bug and adding debugging

* adding blob ranges unit test

* testing both blobbify cases in cancel

* formatting

* switch to explicit blocking api instead of boolean flag

* remove comments

* format
2023-02-17 12:20:53 -06:00
Josh Slocum c26831ec04
adding version metadata to blob granule file pointers (#9392) 2023-02-16 17:11:11 -06:00
Josh Slocum eefc889389
Add tenant and encryption support to new bg file apis (#9315)
* Add tenant and encryption support to new bg file apis

* formatting

* fixing comment style for linter
2023-02-15 11:48:40 -06:00
Vaidas Gasiunas afc25035f8
Client status report API in Java and python bindings (#9366)
* get_client_status: add to Java bindings

* Add get_client_status in python binding

* Make python unit tests available as ctest

* Fix file name in the copyright header

* Fix library path name for mac

* get_client_status: Minor changes in Java & Python bindings addressing review comments

* Rename fdb_python_unit_tests to unit_tests
2023-02-15 18:00:53 +01:00
Junhyun Shim 380a5aa8e8
Merge pull request #9335 from sfc-gh-jshim/fix-mako-token-reassign-after-reset
Mako: fix token not being reassigned after every reset
2023-02-09 22:14:39 +01:00
Josh Slocum 81c984e48a
adding encryption at rest support to local cluster and api tester (#9325)
* adding encryption at rest support to local cluster and api tester

* adding encrypted variant of bg tenant test and renaming ear
2023-02-09 10:23:17 -06:00
Junhyun Shim 357cec17d8 Mako: fix createNewTransation return value
Should return token instead of tenant name
2023-02-09 16:00:48 +01:00
Junhyun Shim 499a7de718 Mako: add missing token reassignment after transaction reset
Also remove redundant calls to tx.reset() in step functions after OP_COMMIT
(The step function caller is already resetting the object after OP_COMMIT is run successfully)
2023-02-09 13:35:21 +01:00
sfc-gh-tclinkenbeard 09ad864eb5 Merge remote-tracking branch 'origin/main' into expose-tag-throttled-duration 2023-02-08 11:25:14 -08:00
Junhyun Shim d7d0b658a3
Merge pull request #9314 from sfc-gh-jshim/authz-tenant-name-to-tenant-id
Make Authz use tenant ids instead of tenant names
2023-02-08 20:13:29 +01:00
Josh Slocum ebbd221fe7
formatting files (#9322)
* formatting files

* another file
2023-02-08 13:01:24 -06:00
Josh Slocum 2f8f7515e8
adding java blob granules unit test (#9317)
* adding java blob granules unit test

* reduce sleep and organize imports
2023-02-08 12:02:14 -06:00
Junhyun Shim d32d3dd085 Make token option NOT survive transaction hard resets 2023-02-08 18:12:22 +01:00
Vaidas Gasiunas e1ec0d1ae2
Fix UBSAN build for C shim library (#9311) 2023-02-07 20:17:07 +01:00
Junhyun Shim c4703b5940 Mako: lower tenant id fetch error to debug
With MVC mode, it always fails at least once for each tenant and gets spammy
2023-02-07 18:44:43 +01:00
Junhyun Shim ff61e2990b Fix clang build error and relax authz test tx timeout 2023-02-07 09:59:39 +01:00
Junhyun Shim 180ddba4ec Fix clang format 2023-02-06 23:14:39 +01:00
Junhyun Shim be225acd2a Merge remote-tracking branch 'origin/main' into authz-tenant-name-to-tenant-id 2023-02-06 23:13:43 +01:00
Josh Slocum 73c9735c21
Bg api tenant tests (#9301)
* fixing tenant creation + setup order

* removing seenReadSuccess since verifyBlobRange is called before test start

* fixing bg_desc skip tenant check
2023-02-06 13:18:27 -06:00
Junhyun Shim 56d3438ea4 Add tenant ID fetch to mako (for token signing) 2023-02-03 23:55:55 +01:00
Junhyun Shim ce652fa284 Replace AuthZ's use of tenant names in token with tenant ID
Also, to minimize audit log loss, handle token usage audit logging at each usage.
This has a side-effect of making the token use log less bursty.
This also subtly changes the dedup cache policy.
Dedup time window used to be 5 seconds (default) since the start of batch-logging.
Now it's 5 seconds from the first usage since the closing of the previous dedup window
2023-02-03 21:46:31 +01:00
Vaidas Gasiunas 6aba6ceb8a
libfdb_c_shim: Load all symbols at once in a thread-safe way; remove unused options of implib.so (#9293) 2023-02-02 19:37:24 +01:00
Vaidas Gasiunas f8b1da8bc6
An option to initialize client tracing in setupNetwork (#9209)
* client_config_tester: use a generic mechanism to set specific network options

* trace_initialize_on_setup option to initialize client traces on network setup without local IP address

* trace_initialize_on_setup: Addressing review comments

* Restore correct formatting

* trace_initialize_on_setup: Update go bindings

* Include PID for identification into trace file names by default

* Use the same naming pattern for trace files in all configurations

* Empty commit
2023-02-02 10:00:51 +01:00
A.J. Beamon b8592c4e09
Merge pull request #9219 from sfc-gh-jfu/tenant-object-binding-tests
Add tenant getId to java/python binding tester
2023-01-31 16:22:38 -08:00
Jon Fu 56bef16a87
Update bindings/bindingtester/spec/tenantTester.md
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2023-01-31 18:01:06 -05:00
Jon Fu 2ade905a60
Update bindings/bindingtester/spec/tenantTester.md
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2023-01-31 18:01:00 -05:00