0e720634f3
EaR: Allow RESTKmsConnector validation token newline char sanitization ( #9831 )
...
Description
Patch proposes ability to remove newline characters from KMSConnector
validation tokens
Testing
RESTKmsConnectorUnit.toml
2023-03-29 16:56:46 -07:00
34e2e5ab87
fmt
2023-03-29 15:07:29 -07:00
6d83bba336
disable failure injection
2023-03-29 15:05:50 -07:00
4cd36b3e7f
optimzing latency of granule open and adding some buffer for speed up sim ( #9780 )
2023-03-29 09:16:45 -05:00
d691e94af2
rename median ratio to pivot ratio; extract updatePivotAvailableSpaceRatio function; add related knobs
2023-03-28 14:51:00 -07:00
ed722ce1c0
fixing system priority flags usage ( #9819 )
2023-03-28 14:46:20 -05:00
56a26b4229
Merge pull request #9812 from sfc-gh-zhzhang/add-comment-on-movingwindow
...
add comments on the usage of MovingWindow and difference with Smoother
2023-03-28 12:42:16 -07:00
484b02611c
modify MovingWindow comment, explain the difference between MovingWindow and Smoother and their use cases
2023-03-27 21:12:19 -07:00
b205862798
Fix finishedQueries metric, add metrics reporting in GetMappedRange t… ( #9796 )
...
* Fix finishedQueries metric, add metrics reporting in GetMappedRange test [release-7.1] (#9785 )
* Fix finishedQueries metric, add metrics reporting in GetMappedRange test
* refactor to make format work
* resolve comments
* Fix more comments
* Fix bugs and change running time of test
* use double for options
2023-03-27 18:17:22 -07:00
ca7959bc07
Merge pull request #9798 from sfc-gh-ajbeamon/speed-up-metacluster-recovery
...
Speed up the runtime of the metacluster recovery tests
2023-03-27 17:11:01 -07:00
d719155462
Merge pull request #9795 from sfc-gh-ajbeamon/speed-up-storefront
...
Speed up the storefront tests
2023-03-27 17:10:21 -07:00
3748693a28
fixing txn flags in new bw rk function ( #9813 )
2023-03-27 15:56:15 -05:00
07594c269b
add comment on where to use MovingWindow rather than Smoother
2023-03-27 11:34:22 -07:00
cb389bf026
Merge pull request #9610 from sfc-gh-jazhuang/encrypt_inplace
...
Add inplace encryption and decryption API
which avoids the memory allocation and memcpy.
2023-03-27 11:21:06 -07:00
7876817592
Merge pull request #5881 from sfc-gh-ajbeamon/fix-slow-task-profiler-mvc
...
Fix the slow task profiler when used with the multi-version client
2023-03-27 10:08:17 -07:00
4a7f7cdfce
Merge pull request #9803 from halfprice/zhewu/exclude-check-existance
...
Do not update exclude/failed system metadata in excludeServers if the input list is already excluded/failed.
2023-03-27 09:38:04 -07:00
b45489641e
Use an random address in the test to not impact the actual cluster
2023-03-24 20:18:37 -07:00
6e1bb08677
Update documentation
2023-03-24 15:29:47 -07:00
18f03ba1a5
Apply format
2023-03-24 15:09:30 -07:00
05574c2d7b
Fix test failure
2023-03-24 15:08:06 -07:00
e0525cc081
Apply format
2023-03-24 15:01:18 -07:00
8211b5d097
Add a check in excludeServer function that if the exclusion list already exists, don't need to issue new writes.
2023-03-24 14:57:31 -07:00
335c76501a
The slow task profiler does not use thread local state that is not pre-initialized for dlopened objects. Chain signal handlers so that we call them for each external library.
2023-03-24 13:44:33 -07:00
02f0a44987
Avoid divide-by-zero in isKeyValueInSample. ( #9799 )
...
In the pathological case that both key size and value size are 0,
the probability of choosing that key-value pair is 0, and we divide
by zero when computing the sampledSize.
This change adds documentation to that function, which was quite
difficult to understand. In addition, we add `probability` to the
returned values, since one of the callers was backing it out from
sampledSize and itself in danger of dividing by zero.
2023-03-24 16:05:26 -04:00
b22ee61497
Speed up the runtime of the metacluster recovery workload by using a simplified configuration for the metacluster
2023-03-24 08:23:59 -07:00
0efd403e59
Add inplace encryption/decryption API
2023-03-23 15:26:22 -07:00
117b6c0a6e
After maxColdStarts is hit, stop the test instead of stopping cold starts. ( #9783 )
2023-03-23 13:50:57 -07:00
f70df04d7c
Remove unused code from storefront test
2023-03-23 13:35:32 -07:00
fead5ed494
Log reason for QuietDatabase check failure. ( #9775 )
...
An 'attribute_not_found' error was slipping through the cracks
when attempting to get the max storage queue size for a storage
server which has been removed. This change explicitly logs the
error where it occurs, making it easier to debug.
2023-03-23 15:02:51 -04:00
547b77ea95
Fix Windows build broken by #9458
2023-03-22 21:58:56 +01:00
495a460887
Merge remote-tracking branch 'origin/main' into fix-arg-type
2023-03-22 10:46:57 -07:00
331ac1db15
Merge pull request #9773 from halfprice/zhewu/peek-tracker-expiration
...
LogCursor timeout check should take when connection failure is enabled into account
2023-03-22 09:22:03 -07:00
b4e62b9b3e
Update log cursor timeout check
2023-03-21 22:03:17 -07:00
90bdfbdc4c
Update info trigger new DB info update immediately
2023-03-21 21:40:12 -07:00
00055bd76b
Merge pull request #9763 from neethuhaneesha/bloom-filter-knobs
...
Adding rocksdb bloom filter knobs.
2023-03-21 20:00:24 -07:00
ffcf51b732
Once we start repairing a dead datacenter, don't allow it to be canceled
2023-03-21 14:44:58 -07:00
89d73e92bb
Merge pull request #9458 from sfc-gh-xwang/fix/main/anyExisted
...
replace actors with class DataDistributionTracker::run and class DDQueue::run
2023-03-21 13:30:39 -07:00
1e656210e1
Adding rocksdb bloom filter knobs.
2023-03-21 13:10:40 -07:00
6f687ece4d
change struct to class, add comment for DD Components class
2023-03-21 10:10:54 -07:00
81c3cb8c50
Psm checkpoint ( #9636 )
...
* Update NativeAPI getCheckpointForRange().
* Implemented checkpoint in SS.
* clean up.
* Disabled StorageServerCheckpointTest.
* Serialized checkpoint creation and deletion.
Simplified checkpoint GC, via deleting CheckpointMetaData::dir.
* Fixed PhysicalShardMove test. Where fetchCheckpoint target range is misset.
* Minor improvements on CheckpointMetaData and DataMoveMetaData.
* fmt.
* Optimized PhysicalShardMove test
cleanup.
* dismiss operation_obsolete, and throw actor_cancelled.
* fmt.
* Resolved commments.
2023-03-21 09:14:10 -07:00
3e76888404
format code
2023-03-20 16:38:35 -07:00
2b2e465f26
solve merge conflicts with Custom Replication PR #9710
2023-03-20 16:30:40 -07:00
303248b0b7
solve conflicts with MovingWindow PR #9591
2023-03-20 16:06:38 -07:00
dea76f62cf
merge upstream/main without completely clean up conflicts
2023-03-20 16:01:00 -07:00
a258d775c3
Merge pull request #9710 from sfc-gh-etschannen/feature-custom-dd
...
Added the ability to manually create a shard and also increase its replication factor
2023-03-20 15:35:10 -07:00
d2c1b3124e
add a field to show average data movement bytes in MovingData trace ( #9591 )
...
* add a field to show average data movement bytes in MovingData trace
* change variable type
* Make changes to variable/function naming and add more comments
* move rolling window struct to a new file; deal with corner case: dd startup, elements are full
* format
* simplify codes
* modify file/struct name, universal to moving window
* fix typo
* add a new Knob to control MovingWindow::Deque size
* make the general use of dequeSize limit
* format
* format, use space rather than tab
2023-03-20 14:33:32 -07:00
ef20f1d973
code cleanup
2023-03-20 13:18:49 -07:00
2b0857f2ee
fix a rare race condition in PerpetualWiggleStatsWorkload.actor.cpp
2023-03-20 13:09:44 -07:00
080837cf86
refactor struct BlobWorkerData and struct GranuleMetadata ( #9659 )
...
* refactor struct BlobWorkerData and struct GranuleMetadata
* undo the change on blobgranuleservercommon
2023-03-20 11:46:27 -07:00
8e4eb83ba7
addressed review comments
2023-03-20 11:41:23 -07:00
Ata E Husain Bohra