Commit Graph

23417 Commits

Author SHA1 Message Date
sfc-gh-tclinkenbeard a70a007dcf Remove outdated comment 2022-10-18 16:27:55 -07:00
Ankita Kejriwal 3d890ced9a Code cleanup 2022-10-18 15:53:22 -07:00
sfc-gh-tclinkenbeard 003986fdb0 Randomize GLOBAL_TAG_THROTTLING knob 2022-10-18 15:16:24 -07:00
sfc-gh-tclinkenbeard 300840ea2e Enable GLOBAL_TAG_THROTTLING by default 2022-10-18 15:16:24 -07:00
sfc-gh-tclinkenbeard dfc11001af Reject transactions that have been tag throttled for too long 2022-10-18 15:16:24 -07:00
Jingyu Zhou 14d13475db
Merge pull request #8437 from sfc-gh-tclinkenbeard/add-quota-clear-command
Add fdbcli "quota clear" command
2022-10-18 15:11:05 -07:00
Ata E Husain Bohra 765aeabb70
Enable EncryptKeyProxy test and add code probes (#8490)
* Enable EncryptKeyProxy test and add code probes

Description

  diff-1: Address review comments

Major changes include:
1. Enable EncryptKeyProxyTest, the test was modified to leverage
GetEncrrptCipherKey actor, as existing code wouldn't work if EKP
process gets restarted while test is running.
2. Add code probes to EKP
3. Minor refactoring.

Testing

EncryptKeyProxyTest - 100K
2022-10-18 13:58:16 -07:00
sfc-gh-tclinkenbeard 142d46400b Reduce severity of trace events for local_config_changed 2022-10-18 13:46:52 -07:00
Ankita Kejriwal bb702e59e9 Update TenantCache to use the API for tenant-aware getEstimatedRangeSizeBytes 2022-10-18 13:39:06 -07:00
Ankita Kejriwal fb014a4834 Merge branch 'main' of github.com:apple/foundationdb into monitorusage 2022-10-18 13:14:47 -07:00
Josh Slocum 89519343a7
adding new bg read metrics to client and refactoring them into a new trace event (#8493) 2022-10-18 14:13:35 -05:00
Xiaoxi Wang a6a53b40fd
Merge pull request #8477 from sfc-gh-xwang/feature/main/moveKey
Implement mock mode moveKeys in MockDDTxnProcessor and simulation test
2022-10-18 11:02:27 -07:00
Jon Fu 930801b483 allow tenantmodes option to specify an array of possible choices 2022-10-18 10:48:27 -07:00
Xiaoxi Wang 08b006efba solve compile warning 2022-10-18 09:49:07 -07:00
Jingyu Zhou d45f7a088b
Merge pull request #8489 from halfprice/zhewu/debug-shard-size
Use consistencyScanInfoFetcher function and add a timeout
2022-10-17 20:28:18 -07:00
Jingyu Zhou 1b2fcdd4f6
Merge pull request #8053 from sfc-gh-akejriwal/getsizetenant
Make the storage metrics functions tenant aware
2022-10-17 20:02:52 -07:00
sfc-gh-tclinkenbeard 8c082dac4e Expand quota tests in fdbcli_tests.py 2022-10-17 18:56:11 -07:00
Ankita Kejriwal 4a08bb6883 Guard the usage of the new `Optional<TenantInfo>` on storage server. 2022-10-17 18:21:42 -07:00
sfc-gh-tclinkenbeard 6bfb5c00fb Merge remote-tracking branch 'origin/main' into add-quota-clear-command 2022-10-17 17:02:42 -07:00
Xiaoxi Wang 6630ec8c1d remove virtual on raw* Methods 2022-10-17 16:43:32 -07:00
sfc-gh-tclinkenbeard 07cc152bf5 Merge remote-tracking branch 'origin/main' into add-quota-clear-command 2022-10-17 16:28:22 -07:00
sfc-gh-tclinkenbeard 7e4f380423 Add tests for fdbcli quota commands 2022-10-17 16:27:45 -07:00
Ankita Kejriwal 3eb41e1598 Make the `WaitMetricRequest::TenantInfo` an `Optional`. 2022-10-17 16:03:21 -07:00
Zhe Wu 550e1e86e8 Also add fetch_consistency_scan_info_timeout to mr-status-json-schemas.rst.inc 2022-10-17 15:35:32 -07:00
Yi Wu 982b96d705
Encryption: fix kms connector knob name (#8479) 2022-10-17 15:13:21 -07:00
Xiaoxi Wang 9c28dd46be add assert to parallelism lock take 2022-10-17 14:42:04 -07:00
Zhe Wu 13a28d026a Return should be optional in consistencyScanInfoFetcher() 2022-10-17 14:15:46 -07:00
Zhe Wu 5096cabc59 Fix schema error 2022-10-17 13:28:00 -07:00
Trevor Clinkenbeard cf935a1915
Merge pull request #8444 from sfc-gh-tclinkenbeard/limit-gtt-size
Limit number of tags tracked by `GlobalTagThrottler`
2022-10-17 12:23:46 -07:00
Steve Atherton 26cd36472d
Merge pull request #8460 from sfc-gh-yiwu/encrypt_encoding
Fix Redwood xor encoding incompatibility with 7.1
2022-10-17 11:51:27 -07:00
Zhe Wu 6e389e4feb Use consistencyScanInfoFetcher function and add a timeout 2022-10-17 11:47:47 -07:00
Dennis Zhou b72cc7c050
Merge pull request #8427 from sfc-gh-dzhou/blob-tenant-api
blob: tenant equivalent apis for managing blob storage
2022-10-17 13:47:22 -05:00
Xiaoxi Wang 5d57429949 modify boolean definition; add comments 2022-10-17 10:12:00 -07:00
Dennis Zhou 6752da5e65 blob/test: check tenant_not_found exception 2022-10-17 11:42:27 -05:00
Dennis Zhou 46ec2f416e blob/test: convert BlobGranuleRangesWorkload to use a tenant on coin flip 2022-10-17 11:42:27 -05:00
Dennis Zhou 4a04e503a6 blob/java: tenant purgeBlobGranules() java api 2022-10-17 11:42:27 -05:00
Dennis Zhou cfe62685e9 blob/java: tenant verifyBlobRange() java api 2022-10-17 11:42:27 -05:00
Dennis Zhou 77e2e4a381 blob/c: tenant verifyBlobRange() c api 2022-10-17 11:42:26 -05:00
Dennis Zhou 1c90fbbc61 blob: tenant verifyBlobRange() native api 2022-10-17 11:42:08 -05:00
Dennis Zhou 4cca9a8c70 blob/java: tenant listBlobbifiedRanges() java api 2022-10-17 11:42:08 -05:00
Dennis Zhou 9d38ddfabc blob/c: tenant listBlobbifiedRanges() c api 2022-10-17 11:42:07 -05:00
Dennis Zhou 4a33de31e9 blob: tenant listBlobbifiedRanges() native api 2022-10-17 11:41:45 -05:00
Dennis Zhou da94188570 blob/java: tenant (un)blobbify() java api 2022-10-17 11:41:45 -05:00
Dennis Zhou a0246caebb blob/c: tenant (un)blobbify() c api 2022-10-17 11:41:44 -05:00
Dennis Zhou 120b38a926 blob: tenant (un)blobbify() native api 2022-10-17 11:41:12 -05:00
Dennis Zhou 0ee0ce62f0 blob: blobGranuleGetTenantEntry() for tenant and database calls
Currently, blobGranuleGetTenantEntry() expects to get the TenantName
through the transaction. Database calls cannot abide by this contract.
So enable the call to take in a TenantName and expect at least 1 to be
set.
2022-10-17 11:41:12 -05:00
Dennis Zhou b2ce2bb72c blob: fix purge & wait tenant apis to use the ITenant interface 2022-10-17 11:41:12 -05:00
Dennis Zhou 622f2a79db api: add TenantBlobRangeApi feature flag and use for purge tenant api 2022-10-17 11:41:02 -05:00
Jon Fu 7969b08f52 change tenantmode type to int and rewrite some reboot logic 2022-10-17 09:38:11 -07:00
Jingyu Zhou 7e3a0b89cf
Merge pull request #8462 from sfc-gh-tclinkenbeard/subtract-proxy-tag-throttle-duration
Subtract `proxyTagThrottleDuration` from measured GRV latencies
2022-10-17 09:26:39 -07:00