380a5aa8e8
Merge pull request #9335 from sfc-gh-jshim/fix-mako-token-reassign-after-reset
...
Mako: fix token not being reassigned after every reset
2023-02-09 22:14:39 +01:00
81c984e48a
adding encryption at rest support to local cluster and api tester ( #9325 )
...
* adding encryption at rest support to local cluster and api tester
* adding encrypted variant of bg tenant test and renaming ear
2023-02-09 10:23:17 -06:00
357cec17d8
Mako: fix createNewTransation return value
...
Should return token instead of tenant name
2023-02-09 16:00:48 +01:00
499a7de718
Mako: add missing token reassignment after transaction reset
...
Also remove redundant calls to tx.reset() in step functions after OP_COMMIT
(The step function caller is already resetting the object after OP_COMMIT is run successfully)
2023-02-09 13:35:21 +01:00
d7d0b658a3
Merge pull request #9314 from sfc-gh-jshim/authz-tenant-name-to-tenant-id
...
Make Authz use tenant ids instead of tenant names
2023-02-08 20:13:29 +01:00
ebbd221fe7
formatting files ( #9322 )
...
* formatting files
* another file
2023-02-08 13:01:24 -06:00
2f8f7515e8
adding java blob granules unit test ( #9317 )
...
* adding java blob granules unit test
* reduce sleep and organize imports
2023-02-08 12:02:14 -06:00
d32d3dd085
Make token option NOT survive transaction hard resets
2023-02-08 18:12:22 +01:00
e1ec0d1ae2
Fix UBSAN build for C shim library ( #9311 )
2023-02-07 20:17:07 +01:00
c4703b5940
Mako: lower tenant id fetch error to debug
...
With MVC mode, it always fails at least once for each tenant and gets spammy
2023-02-07 18:44:43 +01:00
ff61e2990b
Fix clang build error and relax authz test tx timeout
2023-02-07 09:59:39 +01:00
180ddba4ec
Fix clang format
2023-02-06 23:14:39 +01:00
be225acd2a
Merge remote-tracking branch 'origin/main' into authz-tenant-name-to-tenant-id
2023-02-06 23:13:43 +01:00
73c9735c21
Bg api tenant tests ( #9301 )
...
* fixing tenant creation + setup order
* removing seenReadSuccess since verifyBlobRange is called before test start
* fixing bg_desc skip tenant check
2023-02-06 13:18:27 -06:00
56d3438ea4
Add tenant ID fetch to mako (for token signing)
2023-02-03 23:55:55 +01:00
ce652fa284
Replace AuthZ's use of tenant names in token with tenant ID
...
Also, to minimize audit log loss, handle token usage audit logging at each usage.
This has a side-effect of making the token use log less bursty.
This also subtly changes the dedup cache policy.
Dedup time window used to be 5 seconds (default) since the start of batch-logging.
Now it's 5 seconds from the first usage since the closing of the previous dedup window
2023-02-03 21:46:31 +01:00
6aba6ceb8a
libfdb_c_shim: Load all symbols at once in a thread-safe way; remove unused options of implib.so ( #9293 )
2023-02-02 19:37:24 +01:00
f8b1da8bc6
An option to initialize client tracing in setupNetwork ( #9209 )
...
* client_config_tester: use a generic mechanism to set specific network options
* trace_initialize_on_setup option to initialize client traces on network setup without local IP address
* trace_initialize_on_setup: Addressing review comments
* Restore correct formatting
* trace_initialize_on_setup: Update go bindings
* Include PID for identification into trace file names by default
* Use the same naming pattern for trace files in all configurations
* Empty commit
2023-02-02 10:00:51 +01:00
b8592c4e09
Merge pull request #9219 from sfc-gh-jfu/tenant-object-binding-tests
...
Add tenant getId to java/python binding tester
2023-01-31 16:22:38 -08:00
56bef16a87
Update bindings/bindingtester/spec/tenantTester.md
...
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2023-01-31 18:01:06 -05:00
2ade905a60
Update bindings/bindingtester/spec/tenantTester.md
...
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2023-01-31 18:01:00 -05:00
e761c1c169
update bindingtester spec
2023-01-31 13:41:39 -08:00
c07657c592
push string onto stack when active tenant is set
2023-01-31 12:34:37 -08:00
dfce17f65f
Add new Blob Granule (BG) APIs for raw blob data access ( #9245 )
...
Adds a prototype of new APIs to access the Blob Granule data:
fdb_future_readbg_get_descriptions
fdb_readbg_parse_snapshot_file
fdb_readbg_parse_delta_file
fdb_result_get_bg_mutations_array
The client first calls fdb_future_readbg_get_descriptions to get a high level description of granules, reads the files and then calls fdb_readbg_parse_snapshot_file and fdb_readbg_parse_delta_file to parse the snapshot and delta files, respectively. This allows the client to get a raw access to the blob granule data, and allows the client to process them in a way they wouldn't be efficiently able to when using previous blob granule read APIs.
We expect these APIs to evolve before a release.
---------
Co-authored-by: Josh Slocum <josh.slocum@snowflake.com>
2023-01-31 15:22:04 +01:00
b4c16e9b97
Merge pull request #9217 from xis19:binding_test
...
Generate bindingtester2 tarball for test
2023-01-30 20:06:16 -08:00
b21a18b4ba
Merge branch 'main' of github.com:apple/foundationdb into tenant-object-binding-tests
2023-01-27 11:19:54 -08:00
27f000bc45
patch to fix some existing bindingtester issues
2023-01-27 10:41:47 -08:00
30ef4f5d27
changing randomKeyRange to randomNonEmptyKeyRange
2023-01-27 10:58:39 -06:00
3b153635e9
add randomKeyRange to api tester with bug fix, and refactor TesterBlobGranuleCorrectnessWorkload to use t
2023-01-26 18:23:25 -06:00
4c2a09aab5
add arg and return type to the c_api for impl.py
2023-01-26 14:51:08 -08:00
840faa0ef4
Add parameter for test_causal_read_risky database option
2023-01-25 16:02:27 -08:00
6493da877a
add method to return idfuture
2023-01-25 12:45:35 -08:00
c2c582202a
Merge branch 'main' of github.com:apple/foundationdb into tenant-object-binding-tests
2023-01-24 09:10:06 -08:00
9a0fd7f999
Generate bindingtester2 tarball for test
...
bindingtester2-${FDB_VERSION} is generated in packages/ directory.
It is possible to run the test by
j start --tarball bindingtester2-7.3.0.tar.gz --max-runs 1000
and submit the test to joshua system. Joshua will run the tests in
parallel and tests will not impact each other. Yet it will take long
time for each run.
2023-01-23 17:56:36 -08:00
4ce1656b17
Merge branch 'main' of github.com:apple/foundationdb into tenant-obj-fetch-id
2023-01-23 13:29:27 -08:00
900ed4f575
Merge pull request #9189 from sfc-gh-cwende/mako-cwende-add-cpu-usage-stats
...
Mako: Add CPU Usage statistics
2023-01-23 09:27:45 -08:00
0e4224851c
mako: improve arg validation comments (worker ~> workflow)
2023-01-23 15:42:32 +01:00
a9ef2d1c99
mako: do not include unnecessary headers
2023-01-23 15:26:13 +01:00
8fb67d28ce
mako: Improve location of CPU utilization measurements and improve how multiple measurements are accumulated
2023-01-23 15:13:48 +01:00
0210bad4ae
add back java optimization
2023-01-20 08:58:16 -08:00
39528b62ea
mako: Rename WorkerStatistics ~> WorkflowStatistsics
2023-01-20 16:36:21 +01:00
e2913b5b3d
mako: add comments
2023-01-20 12:27:03 +01:00
7d1e8e10f0
mako: add cpu usage statistics, including some refactoring of statistics accumulation
2023-01-20 11:14:36 +01:00
d5c8786fdf
revert changes that could lead to race condition
2023-01-19 15:23:40 -08:00
2882f86aac
Merge branch 'main' of github.com:apple/foundationdb into tenant-obj-fetch-id
2023-01-19 14:42:29 -08:00
fb4daf936d
possible fix for memory errors
2023-01-19 14:42:11 -08:00
df0999bee2
mako: improve argument validation
2023-01-18 20:17:50 +01:00
e3c3922cc5
Merge pull request #9114 from sfc-gh-vgasiunas/vgasiunas-client-status-report
...
API for Client Status Report
2023-01-17 11:49:34 +00:00
4b9db3309f
client config tests: Improve readability of ClientConfigTest interface
2023-01-16 17:38:47 +01:00
e152fb28af
client_status_report: report cluster id from the DatabaseContext only
2023-01-16 14:57:46 +01:00
Junhyun Shim