Commit Graph

21545 Commits

Author SHA1 Message Date
Ata E Husain Bohra 9a3e88df46
Fix ASAN build (#7629)
* Fix ASAN build

Description
  -diff-2: Fix Mac build issues
  -diff-1: Address review comments

Patch addresses the issue where ASAN build failed after introducing
BlobGranule compression.

Testing

ASAN build
2022-07-20 14:14:46 -07:00
A.J. Beamon 37b7666262 Add a comment to name the fold expression syntax in makeTuple. This should make it easier to look up for those unfamiliar with the syntax. 2022-07-20 13:57:55 -07:00
Jon Fu 762c01d567 add error check for overlap 2022-07-20 13:43:13 -07:00
Zhe Wu aa2740e21e Increase AllTags field length in TLogReady 2022-07-20 13:17:21 -07:00
A.J. Beamon f6a47a18e9 Use a constexpr check for deserialization (from code review) 2022-07-20 13:01:36 -07:00
Josh Slocum c066597af1
Merge pull request #7644 from sfc-gh-jslocum/granule_merging_converge
Granule merging converge
2022-07-20 15:00:19 -05:00
Trevor Clinkenbeard 1020d5b1ad
Merge pull request #7641 from harikb/upstream-clean
Backups, Azure, Issue 7570: Check existance of container before creation attempt
2022-07-20 12:43:54 -07:00
Josh Slocum 2a0381f44d
Merge pull request #7603 from sfc-gh-ahusain/ahusain-fix-test
Fix snapshotFormatUnitTest infinite loop
2022-07-20 14:17:39 -05:00
Josh Slocum 8ccf18f35c cleanup 2022-07-20 12:52:21 -05:00
Josh Slocum 316b7a5344 Merge branch 'main' into granule_merging_converge 2022-07-20 12:13:48 -05:00
Josh Slocum cc5ba89fcf
Merge pull request #7612 from sfc-gh-jslocum/granule_merging_batch
Granule merging batch
2022-07-20 11:59:55 -05:00
Jingyu Zhou fc8cf679a0
Merge pull request #7638 from jzhou77/main
Fix ScopeEventFieldTypeMismatch error for TLogMetrics
2022-07-20 09:50:12 -07:00
Hari Bhaskaran 3aec508aec Issue 7570: Check existance of container before creation attempt 2022-07-20 09:40:49 -07:00
Josh Slocum 12ccd3b146 typo 2022-07-20 09:35:57 -05:00
Josh Slocum e0f6897481 fixing merge conflicts 2022-07-20 09:11:37 -05:00
Junhyun Shim b521dc2f58 Bind DeterministicRandom to OpenSSL RNG 2022-07-20 16:03:09 +02:00
Josh Slocum 6e43a50ea1 cleanup 2022-07-20 08:39:32 -05:00
Josh Slocum 5540f92e2e Refactoring randomExp to the proper place 2022-07-20 08:36:03 -05:00
Josh Slocum e3cbd63b6d fixing merge conficts 2022-07-20 08:20:48 -05:00
Josh Slocum 3f8f44dd16 Merge branch 'main' into improved_cf_testing 2022-07-20 08:19:52 -05:00
Josh Slocum 922a4523a1 disabling popped data checking again 2022-07-20 08:19:27 -05:00
Josh Slocum 0b674bf0c4 Merge branch 'main' into cf_bw_operational_fixes 2022-07-20 08:03:59 -05:00
Josh Slocum fd9201f60b Merge branch 'main' into cf_metadata_rewrite 2022-07-20 07:55:00 -05:00
Josh Slocum 44885aa719 cleanup 2022-07-20 07:46:57 -05:00
Josh Slocum 78b6a96006 Merge branch 'main' into granule_merging_batch 2022-07-20 07:42:26 -05:00
Josh Slocum 4000682578 moving comment 2022-07-20 07:35:30 -05:00
Junhyun Shim 0874e553cd Place generateRandomData() under {I|Deterministic}Random 2022-07-20 13:21:11 +02:00
Jingyu Zhou 0f094d2aa1 Fix ScopeEventFieldTypeMismatch error for TLogMetrics
Backport changes made to TLogServer in #4616 back to old TLog implementations.
Old implementations were using SpecialCounter, which is string. The new type
is int64_t. Without the change, we can have many events like:

<Event Severity="30" Time="1658165532.958152" DateTime="2022-07-18T17:32:12Z" Type="ScopeEventFieldTypeMismatch" ID="0000000000000000" EventType="TraceEvent.TLogMetrics" FieldName="QueueDiskBytesUsed" OldType="Int64" NewType="String" ThreadID="2451559325190099131" Machine="10.242.248.26:4703" LogGroup="xxxx" Roles="TL" />
2022-07-19 22:27:29 -07:00
Jingyu Zhou a7469b925b
Merge pull request #7630 from jzhou77/main
Add getMappedRange latency metrics
2022-07-19 22:13:50 -07:00
Jingyu Zhou e8baba8009
Merge pull request #7575 from xis19/lb
Notes on Load Balancer
2022-07-19 17:50:25 -07:00
Josh Slocum 12b6f386cb Refactoring granule flush to retry properly on granule rollback 2022-07-19 19:49:20 -05:00
Lukas Joswiak c357a90b30 Ensure change coordinators request came from same generation proxy
There was a rare but possible issue where a change coordinators request
could be in flight, but reading `\xff/coordinators` would return the old
set of coordinators, even though a previous attempt to write it returned
`commit_unknown_result`. This happened if there was an unrelated
recovery between setting `\xff/coordinators` and the updated
coordinators reaching each machine. The `commit_unknown_result` caused
by this recovery meant the change coordinators retry loop would read
`\xff/coordinators`, but since the request was ongoing it would read the
old set of coordinators. The fix is to have the cluster controller
ignore any change coordinators request from an old generation, meaning
when the retry loop reads the old coordiantors from `\xff/coordinators`,
it is guaranteed that the in progress change coordinators message will
be rejected when arriving at the cluster controller.
2022-07-19 17:44:48 -07:00
Josh Slocum 166de4b704 Fixing merge convergence bugs 2022-07-19 18:44:40 -05:00
Jingyu Zhou 72e72f6d87 Add getMappedRange latency metrics 2022-07-19 16:31:24 -07:00
Jingyu Zhou bc62b538b1
Merge pull request #7627 from jzhou77/remove-metrics
Remove unused "readQueueSizeMetric"
2022-07-19 15:55:52 -07:00
Dan Lambright 7e296c2367
simple replication (#7625) 2022-07-19 18:30:34 -04:00
Markus Pilman 3327ab395b Change test harness to include comments 2022-07-19 15:41:53 -06:00
Jingyu Zhou fde5aeeb62 Remove unused "readQueueSizeMetric" 2022-07-19 14:38:10 -07:00
A.J. Beamon 537ceff8ac Remove the ability to configure a tenant subspace. Rename the prefixes used for tenant metadata. 2022-07-19 14:32:05 -07:00
Xiaoxi Wang a5fba6031f resolve conflict upstream/main 2022-07-19 13:55:51 -07:00
Xiaoxi Wang 43099bda0d resolve conflict upstream/main 2022-07-19 13:48:39 -07:00
A.J. Beamon 190ad8c7e9 Convert existing tuple usages to use Tuple::makeTuple() 2022-07-19 13:45:59 -07:00
Xiaoxi Wang 7865ead54d Merge branch 'main' into readaware 2022-07-19 13:35:33 -07:00
Xiaoxi Wang dea775ad0d
Merge pull request #7580 from sfc-gh-xwang/doc/readaware
update data distributor design doc
2022-07-19 13:29:12 -07:00
Markus Pilman 1de37afd52
Make TEST macros C++ only (#7558)
* proof of concept

* use code-probe instead of test

* code probe working on gcc

* code probe implemented

* renamed TestProbe to CodeProbe

* fixed refactoring typo

* support filtered output

* print probes at end of simulation

* fix missed probes print

* fix deduplication

* Fix refactoring issues

* revert bad refactor

* make sure file paths are relative

* fix more wrong refactor changes
2022-07-19 13:15:51 -07:00
Josh Slocum 19893b4b7a Persisting change feed metadata version to fix fetch/destroy race across restarts 2022-07-19 14:20:14 -05:00
Josh Slocum b9317bebca Reducing ss injection rates 2022-07-19 14:10:47 -05:00
Josh Slocum acc5aee89e Fixed change feed validation issue 2022-07-19 14:10:10 -05:00
Xiaoxi Wang 9dfd58978f
Apply suggestions from code review
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2022-07-19 12:03:49 -07:00
Xiaoxi Wang 1c543e3b4a add unittest 2022-07-19 11:58:24 -07:00