4878762af4
Add Runtime measured by TestHarness
2023-02-21 11:15:13 -07:00
428eb07766
Merge branch 'main' of github.com:apple/foundationdb into split-tenant-metadata
2023-02-21 10:11:35 -08:00
2497aa5701
Clamp GetKeyServerLocations result to tenant prefix ( #9424 )
2023-02-21 18:55:24 +01:00
bef39ffc64
Merge pull request #9084 from sfc-gh-akejriwal/fdbcli
...
Add fdbcli commands for checking the status of and clearing old idempotency ids
2023-02-21 08:44:46 -08:00
06ee5f1e76
Disable client memory wipe test for all XSAN builds ( #9409 )
2023-02-21 14:10:44 +01:00
246fd1dd4e
Remove auto cache option since there is no meaningful implementation of this yet. Change places using trState in a native Transaction to set cache mode or Low/Normal/High priority to use the new transaction options instead.
2023-02-21 02:50:30 -08:00
9bf28899d4
Add transaction option definitions for read priority and read server side cache mode.
2023-02-21 00:54:35 -08:00
fa60f1b4fa
RESTClient: Initialize RESTClient connection pool instance ( #9414 )
...
Description
Patch fixes an issue where new connection for a corresponding
'connectKey' isn't getting added to the connectionPoolMap.
Testing
Standlone fdbserver triggering RESTClient connection path
2023-02-20 19:32:10 -08:00
398079db3a
Merge remote-tracking branch 'origin/main' into expose-tag-throttled-duration
2023-02-20 17:54:06 -08:00
4f9e86b0a4
fixed two bugs that prevented the blob manager from properly loading worker affinity
2023-02-20 16:47:26 -08:00
a5238eaeb3
Allow fetch keys to do more work when mutation stream is infrequent and low throughput. ( #9398 )
2023-02-20 13:38:04 -08:00
bfb3ffc509
added c and java apis for granule flush ( #9412 )
2023-02-20 10:28:11 -06:00
175307a590
Fix determinism in the generated bindingtester API tests ( #9420 )
...
* Reformat bindingtester api test generator with black
* Fix determinism in the generated bindingtester API tests
2023-02-20 15:58:51 +01:00
e169e65021
Fix to BTree node rebuild logic - rebuild when imbalance hits a limit controlled by a new knob.
2023-02-19 16:40:28 -08:00
487b444da9
Merge pull request #9416 from sfc-gh-ajbeamon/fix-tester-tenant-delete-bug
...
When clearing tenants at the end of a simulation test, reset the transaction when looping
2023-02-18 20:25:15 -08:00
eac757d186
EaR: cleanup encryption knobs ( #9386 )
...
Changes:
* Cleanup all encryption knobs
* Update simulated cluster to randomly enable encryption with higher probability
2023-02-18 13:18:20 -08:00
c2ca21cdb4
Merge pull request #9417 from sfc-gh-ajbeamon/fix-restore-id-logic
...
Fixes to metacluster restore ID
2023-02-18 06:35:13 -08:00
3163201201
Restore ID fixes: we weren't generating a restore ID; we weren't setting the restore ID on the management cluster in some restore modes; it is possible in some test scenarios to encounter a restore conflict, in which case we need to retry.
2023-02-17 21:20:06 -08:00
b74a35a986
Enable STORAGE_QUOTA_ENABLED knob by default
2023-02-17 21:14:46 -08:00
95156198b5
When clearing tenants at the end of a simulation test, reset the transaction when looping
2023-02-17 21:13:53 -08:00
1aef6cb5f7
Merge remote-tracking branch 'origin/main' into expose-tag-throttled-duration
2023-02-17 20:41:59 -08:00
a524c563c5
Merge pull request #9411 from sfc-gh-sporwal/sanporwa_cmakelists_change
...
Adding support to pass custom fdb_build timestamp, required to achieve uniform naming across different builds
2023-02-17 17:22:43 -08:00
323a257f1f
Add stats counters for manifest dump
2023-02-17 16:22:45 -08:00
8e6800663b
add missing txn reset
2023-02-17 15:22:04 -08:00
762cbcdc5d
unconditionally set restore id
2023-02-17 14:41:41 -08:00
edb7a51b7e
Revert "let client supply restore id"
...
This reverts commit 5fe32b8503
2023-02-17 14:37:22 -08:00
5fe32b8503
let client supply restore id
2023-02-17 14:01:58 -08:00
5d12b05090
Merge pull request #9369 from sfc-gh-ahusain/ahusain-fdbcore-3951
2023-02-17 13:11:00 -08:00
bdba85a86f
Merge pull request #9303 from sfc-gh-huliu/logtruncation
...
Truncate mutation logs after flushing blob granules
2023-02-17 12:52:45 -08:00
07cdd34f26
Update metacluster_fdbcli_tests.py ( #9406 )
...
Update metacluster_fdbcli_tests.py
This commit has no impact on functionality.
Test plan:
- ctest -R metacluster_fdbcli_tests.py
2023-02-17 12:40:02 -08:00
b3d3889328
EaR: Fix ASAN OOM failure - EncryptionOps
...
Description
Fix ASAN build OOM failure while running OOM error.
Patch addresses the issue by avoiding using a global arena shortening
the lifecycle of allocation per iteration. Recently test was extended
to support 'configurable encryption' codepath coverage, hence, per
iteration the memory allocation was doubled.
Testing
EncryptionOps - ASAN compatible
2023-02-17 11:49:16 -08:00
253934bb82
Merge pull request #9395 from sfc-gh-akejriwal/tenantmap
...
Assert that `checkTenantEntry()` on storage server is reading tenantMap at a legal version
2023-02-17 11:42:37 -08:00
653a5eee28
EaR: Configurable encryption support for Redwood ( #9359 )
...
Supporting configurable encryption for Redwood, which supports switching to different encryption algorithm and having variable size encryption header.
Currently to support both old (non-configurable) and new (configurable) encryption header, the PR assume we have a fixed size encryption header (104 bytes) which is large enough to fit both kind of encryption header. Moving forward the plan is to update the IPager interface to support variable size encoding header, and when Redwood tries to in-place update a page but the reserved encoding header buffer is not large enough, rebuild the page instead.
2023-02-17 10:58:48 -08:00
0d7b6d626b
update restoreCluster test to account for conflicting_restore
2023-02-17 10:36:28 -08:00
6c2fb13173
adding wait parameter to blobbify api ( #9360 )
...
* adding wait parameter to blobbify api
* formatting
* fixing comment style
* fixing bug and adding debugging
* adding blob ranges unit test
* testing both blobbify cases in cancel
* formatting
* switch to explicit blocking api instead of boolean flag
* remove comments
* format
2023-02-17 12:20:53 -06:00
aa1d983132
Truncate logs after force-flushing cold blob granules
2023-02-17 10:17:04 -08:00
18e1a78815
Merge pull request #9396 from sfc-gh-satherton/platform-total-space-correction
...
Adjust reported total space for a disk by the reserved space which normal users cannot use.
2023-02-17 10:05:26 -08:00
aba2188491
Merge pull request #9399 from sfc-gh-satherton/read-after-shutdown-protection
...
Shut down PriorityMultiLocks more gracefully
2023-02-17 10:04:51 -08:00
dd8ff53b91
Merge pull request #9397 from sfc-gh-satherton/redwood-used-bytes-update
...
Update StorageBytes::used reported by Redwood to be the physical file size
2023-02-16 23:59:10 -08:00
9d2074224e
Added more detailed comments to StorageBytes fields.
2023-02-16 23:55:47 -08:00
bca42ed232
Merge commit '99b23ac04d302b1edc6db04f1488a20f8f772ae1' into redwood-used-bytes-update
2023-02-16 22:07:44 -08:00
cc1c1d5435
Merge commit '99b23ac04d302b1edc6db04f1488a20f8f772ae1' into platform-total-space-correction
2023-02-16 22:06:49 -08:00
99b23ac04d
EaR: Configurable encryption support for Tlog mutations ( #9394 )
...
* EaR: Configurable encryption support for TLog mutations
Description
diff-1 : Address review comments
Major changes includes:
1. Update the code involved in ensuring Tlog mutation encryption to be
compliant with "configurable encryption" feature.
2. Update ENABLE_CONFIGURABLE_ENCRYPTION flag to be 'true' by default
and BUGGIFY it.
Testing
devRunCorrectness - 100K
2023-02-16 19:01:59 -08:00
da7d3c1129
Merge branch 'main' of github.com:apple/foundationdb into tenantmap
2023-02-16 16:06:10 -08:00
ccba8731dd
Math bug fix.
...
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2023-02-16 15:48:16 -08:00
fd231e3f14
Configurable Encryption Support for TxnStateStore ( #9387 )
...
Configurable encryption for Transaction State Store
2023-02-16 15:20:14 -08:00
c26831ec04
adding version metadata to blob granule file pointers ( #9392 )
2023-02-16 17:11:11 -06:00
e03eca778c
Configurable Encryption Support for Backup ( #9375 )
...
Snapshot backup configurable encryption support
2023-02-16 15:03:27 -08:00
53fc43a3a6
Merge branch 'main' of github.com:apple/foundationdb into split-tenant-metadata
2023-02-16 14:46:03 -08:00
c3d6ae0213
Throw invalid_tenant_configuration when changing assigned cluster ( #9350 )
...
Since we currently do not support tenant movement, we should as well explicitly disallow changing the assigned
cluster of a tenant during configuration by throwing `invalid_tenant_configuration` for now.
Test plan:
- add coverage for changing assigned cluster during tenant configuration
- fdbcli
- simulation tests
2023-02-16 14:20:59 -08:00
Markus Pilman