6c15506c36
Fixed tests
2023-02-24 11:32:37 -07:00
c1f80fe471
Merge remote-tracking branch 'origin/main' into features/tenant-lock-fdbcli
2023-02-23 15:16:14 -07:00
792950dbdc
Merge pull request #9434 from sfc-gh-huliu/splitmetrics
...
Implement SplitMetric pagination in blob migrator
2023-02-23 14:10:27 -08:00
8759fd8f12
Fix refactoring mistake
2023-02-23 14:41:27 -07:00
193e517cc4
Address review comments and move lock ID into TenantMapEntry
2023-02-23 14:25:36 -07:00
e151a2d363
Merge pull request #9451 from sfc-gh-ajbeamon/metacluster-management-workload-restore-support
...
Improve restore support in the metacluster management workload
2023-02-23 13:10:31 -08:00
efc5bf9ee8
Merge pull request #9456 from sfc-gh-ajbeamon/smaller-tenant-in-txn-state-store
...
Store a smaller tenant object in the txn state store
2023-02-23 14:00:12 -07:00
9e9a31c0f1
Use error variable consistently
2023-02-23 11:27:53 -08:00
3d8b8a2a05
Merge pull request #9450 from sfc-gh-ahusain/ahusain-misc-fixes
...
EaR: RESTClient and EKP changes to handle unreachable external KMS
2023-02-23 10:04:12 -08:00
dd650215d4
Store a smaller tenant object in the txn state store
2023-02-23 09:29:33 -08:00
402f618180
Default transaction options for report_conflicting_keys and used_during_commit_protection_disable ( #9441 )
...
* Introducing default transaction options for report_conflicting_keys and used_during_commit_protection_disable, set the latter option always in Java bindings
* Reformatting TransactionIntegrationTest.java
* Update description of transaction_report_conflicting_keys option
* Remove dependency between mock and real database implementation in RangeQueryTest.java
* Update generated.go after changing desciption of an option
* Small improvements of the TransactionIntegrationTest code
2023-02-23 18:05:01 +01:00
16da8022f2
Merge pull request #9431 from sfc-gh-mpilman/features/testharness-include-config-string
...
Include configure string in test harness output
2023-02-23 10:02:36 -07:00
7d079690d4
Merge branch 'main' into ahusain-misc-fixes
2023-02-22 18:11:11 -08:00
a76af5c696
Improve restore support in the metacluster management workload
2023-02-22 17:42:36 -08:00
1f7ee9437f
EaR: RESTClient and EKP changes to handle unreachable external KMS
...
Description
Two major changes proposed are:
I)
Used following setup for testing:
1. Run `fdbserver` locally.
2. Run a mock python based HTTP server (encryption endpoints not implemented)
Expectation was RESTClient code should go in loop trying to establish connection
to the desired encryption endpoint. However, observation was the code loops for
one cycle and followup cycle SEGV while printing a log using RESTUrl object which
is obtained as a 'pointer' from the caller. Update the code to use RESTUrl object
instead of the pointer.
II) In above setup, KMSConnector would throw 'encrypt_key_fetch_failed' error
which wasn't handled by EKProxy, hence, causing the service to terminate. Add
code to re-throw the error to the caller.
Testing
2023-02-22 17:15:34 -08:00
9b906d9b3d
Merge pull request #9447 from sfc-gh-ajbeamon/metacluster-restore-fixes
...
Metacluster restore fixes
2023-02-22 17:07:19 -08:00
0fba65a3cd
Implement SplitMetric pagination in blob migrator
2023-02-22 16:00:49 -08:00
46dd75ed06
Fix compilation issues after merging with main
2023-02-22 16:51:16 -07:00
230170a431
Merge remote-tracking branch 'sfc/features/tenant-lock-fdbcli' into features/tenant-lock-fdbcli
2023-02-22 16:29:28 -07:00
7d7ca0bb34
Apply suggestions from code review
...
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2023-02-22 16:28:53 -07:00
b1762916fb
Merge remote-tracking branch 'origin/main' into features/tenant-lock-fdbcli
2023-02-22 16:27:24 -07:00
87cb21be06
Merge pull request #9310 from sfc-gh-mpilman/features/tenant-lock2
...
Tenant Lock
2023-02-22 15:18:14 -08:00
33431f062d
Add some trace events, use a more appropriate error, and improve a check of allocated tenant groups
2023-02-22 14:39:51 -08:00
4e31cd7582
Fix compilation error due to TenantLockState being moved to a different namespace
2023-02-22 15:21:47 -07:00
a5a8c57a38
Fix some merge issues and missing updates to use new boolean parameters
2023-02-22 12:52:58 -08:00
91df95e816
If registering a cluster fails on the data cluster, try to rollback the registration on the management cluster
2023-02-22 12:30:50 -08:00
587c47832c
Swap the register and remove cluster opertations (no change to the code)
2023-02-22 12:30:50 -08:00
6dad4c5c60
Improve trace event
2023-02-22 12:30:50 -08:00
c4ef32c77a
Check for registraton tombstones when registering a cluster during restores
2023-02-22 12:30:50 -08:00
92011b9339
When erasing tenants during a force removal, tenants being renamed were double counted against the tenant count
2023-02-22 12:30:50 -08:00
1b9d4a8d5a
Registering a restoring data cluster didn't detect cases where it should fail, such as if the cluster already existed
2023-02-22 12:30:50 -08:00
7da247cde2
Prevent operations on clusters that are restoring
2023-02-22 12:29:32 -08:00
f06ed85044
Update the tenant and metacluster consistency checks to account for the possibility of renamed tenants or partially registered clusters
2023-02-22 12:29:32 -08:00
ec79ecce73
Add a boolean parameter for ForceRemove; rename ForceJoinNewMetacluster to ForceJoin
2023-02-22 12:26:24 -08:00
0c55749f65
Merge pull request #9444 from sfc-gh-ajbeamon/check-metacluster-restore-dryrun
...
Check metacluster restore dryrun
2023-02-22 12:16:02 -08:00
51bd28851b
Merge remote-tracking branch 'sfc/features/tenant-lock2' into features/tenant-lock2
2023-02-22 13:12:44 -07:00
8695fc15fc
Merge remote-tracking branch 'origin/main' into features/tenant-lock2
2023-02-22 13:12:23 -07:00
006a2ead6f
Merge branch 'main' into check-metacluster-restore-dryrun
2023-02-22 11:16:45 -08:00
18ae6bda12
Fix formatting issue
2023-02-22 11:12:42 -08:00
935cd70600
Use MetaclusterData and TenantData in the MetaclusterConsistencyCheck and TenantConsistencyCheck
2023-02-22 11:04:42 -08:00
9cd0f32e87
Fixing several metrics issues in blob workers ( #9426 )
...
* fixing int vs int64 data type, and fixing cause of incorrect request counter
* fixing incorrect count of mutation bytes buffered on granule cancel
2023-02-22 11:08:12 -06:00
23df46773d
Merge pull request #9422 from sfc-gh-satherton/client-read-options
...
Add transaction option definitions for read priority and read cache
2023-02-22 09:00:25 -08:00
9a8c346d1a
Merge pull request #9439 from sfc-gh-vgasiunas/vgasiunas-fix-java-getclientstatus-test
...
Fix Java GetClientStatusIntegrationTest
2023-02-22 08:58:56 -08:00
354bfef099
Added blob granules authz test, and fixed a bug it found ( #9433 )
...
* Adding blob granules authz test
* Fixing tenant race found by authz test
2023-02-22 10:53:45 -06:00
bf97c3dbce
adding java tenant blob management test and fixing bug it found ( #9428 )
2023-02-22 10:52:26 -06:00
d18fffd251
Fix one item that the metacluster restore dry-run testing turned up as changing
2023-02-22 08:41:16 -08:00
cb57541c98
Add testing that the metacluster restore dry-run mode doesn't change anything
2023-02-22 08:41:16 -08:00
cd0696e1cd
Fix Java GetClientStatus integration test by wait on the future
2023-02-22 12:46:26 +01:00
806cef8f2d
Update generated.go to reflect new options.
2023-02-22 00:32:08 -08:00
a21b2fe9f9
Simplified read priority option to three separate options for normal/low/high priority.
2023-02-21 22:48:38 -08:00
Markus Pilman