364bf062cb
A few fixes to prevent simultaneous a simultaneous restore and removal from both making progress:
...
1. Change the cluster ID each time the restore registers the cluster
2. Handle commit unknown result in the removal purge
3. Delete the active restore ID when a removal is first recorded rather than at the end of the removal
4. Delete any existing active restore IDs when registering a cluster in the management cluster
2023-02-25 22:52:02 -08:00
97c355085c
Merge pull request #9487 from sfc-gh-ajbeamon/fix-tenant-lock-test-maybe-committed
...
Fix maybe committed issue in tenant lock test
2023-02-25 22:11:59 -08:00
b5b7d51213
Fix maybe committed issue in tenant lock test
2023-02-25 20:24:16 -08:00
e6a4b0489e
Run a couple restore transactions using the correct runRestoreManagamentTransaction function in order to verify that the restore is still valid
2023-02-25 19:59:59 -08:00
8e231f8809
During a dry-run restore, it is possible that the tenants being restored are modified concurrently. Handle this case with an output message.
2023-02-25 19:59:29 -08:00
b869f5a6ac
Don't validate the configuration sequence number of a tenant during tenant reconciliation until we've started a transaction and confirmed the restore is still valid
2023-02-25 19:58:41 -08:00
b1111ce112
When renaming a tenant during a restore, use the rename destination for the tenant if it has one
2023-02-25 19:57:59 -08:00
3aca47e600
When reconciling tenants during a restore, if a tenant is in the removing state on the management cluster, remove it from the data cluster
2023-02-25 19:54:30 -08:00
846b3c731d
Update metacluster consistency check to handle tenants that are in the process of being renamed correctly
2023-02-25 19:52:07 -08:00
040d44927b
Store the rename destination for tenant movements in the crluster tenant index with an ID of -1. Use this to filter out tenant aliases when modifying the tenant count during a tenant purge.
2023-02-25 19:51:21 -08:00
fddec2b573
Add restore support to the metacluster management concurrency workload
2023-02-25 19:27:04 -08:00
92a90c78d2
clean format
2023-02-25 18:13:55 -08:00
68b447883e
Merge pull request #9481 from sfc-gh-ajbeamon/allow-tenant-group-capacity-override
...
Add an option to allow exceeding the tenant group capacity limit when changing tenant configuration
2023-02-25 18:02:11 -08:00
8a88df0e91
Query backup size from a specific snapshot
2023-02-25 17:38:27 -08:00
a94dd3a430
Fix fdbbackup query returning earliest version
2023-02-25 16:44:45 -08:00
217b52103c
Clean up some code for the tenant configure command; Add a second test with an invalid configuration string, this time with an unknown token and a prior valid configuration string
2023-02-25 13:08:02 -08:00
c26ef88059
knob lower case
2023-02-25 09:26:21 -08:00
8c3ee768a2
Add an option to allow exceeding the tenant group capacity limit when changing tenant configuration
2023-02-24 21:01:36 -08:00
1c71056e26
Merge pull request #9479 from sfc-gh-nwijetunga/nim/enforce-metacluster-tenant-mode
...
Enforce Disabled Tenant Mode in Metacluster
2023-02-24 19:27:57 -08:00
99a1fb52e3
Prevent divison by 0
2023-02-24 18:36:55 -08:00
6b121de6a6
Merge pull request #9464 from jzhou77/fix
...
Add exclude to fdbcli's configure command
2023-02-24 16:31:02 -08:00
2f9cbba2a6
Avoid double evaluation of macro arguments
2023-02-24 16:20:26 -08:00
c1087187d1
format change
2023-02-24 15:43:40 -08:00
836ec1a908
add failure test
2023-02-24 15:42:29 -08:00
c8b7cff10c
fix api test
2023-02-24 15:26:59 -08:00
6187811f71
Reworking getBlobGranuleRanges to also use commit proxy rpc for authz, and adding test ( #9470 )
2023-02-24 17:15:32 -06:00
204b31bc87
Merge pull request #9472 from sfc-gh-ajbeamon/fix-invalid-iterator-use
...
Fix memory error from using invalidated iterator
2023-02-24 14:55:28 -08:00
eca98afcb0
metacluster check tenant mode
2023-02-24 13:59:54 -08:00
8872e5a462
Merge pull request #9347 from sfc-gh-etschannen/feature-change-feed-cache
...
added a disk to blob workers
2023-02-24 13:59:03 -08:00
17bcbaeb03
add tenant reopen to ensure no races with tenant opening ( #9476 )
2023-02-24 15:34:57 -06:00
acf1dfb245
Fix formatting
2023-02-24 13:00:57 -08:00
4a38bb4c3f
Allow performing assert comparisons (e.g. ASSERT_EQ) with any traceable type
2023-02-24 12:53:01 -08:00
e3a61b9b22
Add metrics to understand tail commit latency ( #9435 )
...
* Add server-side latency metrics for Resolver requests.
* Add separate resolver latency metrics for queue wait and compute time.
* Add histogram for queue depth observed on resolver (during metrics interval).
* Fix tlog latency measurement to use timer() instead of now().
2023-02-24 14:13:12 -05:00
998a5b7c0e
enable read-aware DD by default and write release notes/doc
2023-02-24 11:11:25 -08:00
01fab190b3
add arrayGenerator for w|rw option
2023-02-24 12:01:43 -07:00
f3673d808b
Replaced the fetchKeysParallelismFullLock with a lock specifically for change feeds to avoid blocking fetches on idle clusters
2023-02-24 10:59:35 -08:00
9a257a60a4
Address review comments
2023-02-24 10:47:32 -08:00
e0df60bd92
Apply suggestions from code review
...
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2023-02-24 11:33:29 -07:00
6c15506c36
Fixed tests
2023-02-24 11:32:37 -07:00
2d936acbdd
Fix memory error from using invalidated iterator
2023-02-24 10:25:38 -08:00
03fbc59bb1
Merge pull request #9461 from sfc-gh-ajbeamon/metacluster-concurrent-restore-testing
...
Metacluster concurrent restore testing
2023-02-24 09:13:51 -08:00
ee9d511d16
Merge pull request #9463 from sfc-gh-mpilman/buildcop/2023-02-23/bugfixes/arm-awssdk
...
Fix build issue with awssdk_target
2023-02-24 09:20:08 -07:00
910965a5a6
Adding additional blob granule authz tests ( #9443 )
...
* added granule location authz tests
* added authz test for blob worker endpoint
* addressing comments
* fixing ide build
2023-02-24 09:32:05 -06:00
344f6977c9
Restores can now throw a cluster_already_exists error in the metacluster management workload if we timeout a restore and have to retry
2023-02-23 20:32:18 -08:00
29819b0645
Change Feed Bug Fix + Encryption Asserts ( #9457 )
...
* add encryption asserts
* modify function name
* address pr comments
* address pr comments
* Trigger Build
2023-02-23 19:33:25 -08:00
2b25cfef8b
Merge branch 'main' into metacluster-concurrent-restore-testing
2023-02-23 16:06:47 -08:00
82bd5796f5
Fix merge conflicts
2023-02-23 16:04:37 -08:00
67f84cc802
Merge pull request #9448 from xis19/main
...
Provide a tool that allows downloading logs when simulation RocksDB f…
2023-02-23 15:55:22 -08:00
0b2e02c402
Fix rare test failures
...
Unclog after DB is recovered, otherwise another recovery may become stuck again.
2023-02-23 15:42:33 -08:00
33f8e90f9f
Split tenant group metadata ( #9446 )
...
* initial commit to split tenant group metadata
* attempt to fix merge errors
* fix compile errors and adjust existing tests
* fix infinite loop and extra ACTOR tag
* direct assignment instead of store
* direct assign instead of store (missed a few)
2023-02-23 18:11:49 -05:00
A.J. Beamon