409ccf3be2
Use snake_case to match status json convention
2020-06-30 17:05:29 +00:00
89c8764cd6
Merge pull request #3432 from xumengpanda/mengxu/fr-applier-perf-circus-PR
...
Fast Restore: Improvements based on circus performance test
2020-06-30 09:10:48 -07:00
e1dfa410c1
Remove "Storages" field from data_distribution_stats
...
It seems like a cool idea, but it feels rushed to me. Reverting for now.
2020-06-30 15:24:16 +00:00
a55b0771c5
Test schemas
...
Also remove an ASSERT_WE_THINK that doesn't seem to hold now that we
include shards
2020-06-30 15:24:16 +00:00
403274bba8
Add schemas, and check dataDistributionStatsSchema
2020-06-30 15:24:16 +00:00
f8bb76a607
Add CLIENT_BUGGIFY
2020-06-30 15:24:16 +00:00
b1d5e99494
Update documentation
2020-06-30 15:24:16 +00:00
1c30adce74
WIP
2020-06-30 15:24:16 +00:00
4a584a6f6b
Fix copy pasta
2020-06-30 15:24:15 +00:00
0db3145e82
Include storage id's in data_distribution_stats
2020-06-30 15:24:15 +00:00
39cb0ec751
Add documentation
2020-06-30 15:24:15 +00:00
e304697eca
WIP
2020-06-30 15:24:15 +00:00
ffd1467367
Add \xff\xff/metrics/health/*
2020-06-30 15:24:15 +00:00
efb61bcac0
Rename knob to FASTRESTORE_TXN_EXTRA_DELAY
2020-06-29 21:16:30 -07:00
3e9c4077a4
Using inbuilt quick sort instead of radix sort
...
Description
Testing
2020-06-29 23:30:26 +00:00
1082ab2caa
fix ClientVersionRef versionString should be passed by ref
2020-06-29 21:23:56 +02:00
1093fecadb
Merge pull request #3430 from MintYiqingchen/master
...
Modify tutorial: 1.fix some output information; 2. add usage comment
2020-06-29 12:08:19 -07:00
a5febfbc75
Remove spurious comments
2020-06-29 10:26:01 -07:00
8f5ee1f4aa
Refine trace events for better perf diagnosis
2020-06-29 10:22:07 -07:00
97e26d8eb0
FastRestore:Count appliedBytes
2020-06-29 10:18:18 -07:00
4b35685e99
FastRestore:Adjust knob based on circus test
2020-06-29 10:13:18 -07:00
44975be5b2
Merge branch 'release-6.2' of github.com:apple/foundationdb into feature-ha-fixes
2020-06-29 10:02:49 -07:00
5e02fd490e
fix: the check for if a teamCollection was tracking a source server was unreliable, leading to scenarios where we would temporarily replicate a shard less than teamSIze
2020-06-29 10:02:27 -07:00
ab56afbaee
Merge branch 'rocksdb-corruption' into rocksdb-fixes
2020-06-29 16:30:55 +00:00
9c2937d4d0
Only check for files/directories when needed
2020-06-29 16:25:36 +00:00
ecf340da88
Corrects spelling mistakes in various markdown files.
2020-06-28 21:30:34 -07:00
efe14d1cec
Merge remote-tracking branch 'upstream/master'
2020-06-28 21:20:35 -07:00
9ee21a1ae5
Fix getting read version while locked
2020-06-28 20:11:46 -07:00
a708e8e09a
Merge pull request #3422 from jzhou77/fdbconvert
...
Fix a spurious SevError and a spammy trace event
2020-06-28 17:42:49 -07:00
f90334c4b0
1.fix some output information; 2. add usage comment
2020-06-29 00:22:14 +00:00
82dfb5ce3f
FastRestore:Update process metrics for restore master
2020-06-28 12:37:04 -07:00
a5396394e6
Merge pull request #3423 from xumengpanda/mengxu/merge-6.3-PR
...
Merge release 6.3 into master and resolve conflicts
2020-06-28 12:01:07 -07:00
22f7f804b8
Merge branch 'release-6.3' into mengxu/merge-6.3-PR
2020-06-28 11:19:39 -07:00
bc98c84346
RestoreLoader release data early and revert Lower priority for RestoreApplierReceiveMutations actor
...
A quick evalution shows lowering priority for receive mutation actor does not help restore speed but hurt it.
2020-06-28 11:12:06 -07:00
8263c25336
Really ignore the error from uploading actor
2020-06-27 22:36:53 -07:00
d883426c6a
Fix spammy GotBackupProgress events
...
Only print this types of events during master recovery and don't log them for
backup workers.
2020-06-27 21:30:38 -07:00
b8c77ead43
Fix spurious SevError from backup workers
...
While displaced backup workers wait for uploading to finish, it can get
connection_failed error, which caused spurious SevError of BackupFailed. Fix
by ignoring any errors from the uploading actor.
2020-06-27 21:24:22 -07:00
026a735703
Test perf without gracefully clear memory
2020-06-27 16:15:56 -07:00
d6381de16f
RestoreLoader:Clear memory per loading param
2020-06-27 15:51:19 -07:00
ca7beb5a26
Fix compilation
2020-06-27 15:21:06 -07:00
f18a0a242d
FastRestore:Loader frees mutation memory immediately after send mutations
2020-06-27 15:19:08 -07:00
e57dba00bd
FastRestore:Lower priority for RestoreApplierReceiveMutations actor
2020-06-27 15:16:38 -07:00
78c45c1200
Knob for txn delay and add back FlowLock to control txn concurrency
2020-06-27 10:13:34 -07:00
ecd2d8b239
FastRestore:Add counters for applier and disable FlowLock on applyStagingKeysBatch
2020-06-27 00:20:54 -07:00
45cc2cacad
changed temporary output location to /tmp
...
if the memory is full, then the data needs to be flushed to disk memory
Testing
2020-06-26 15:15:42 +00:00
1832b88e3f
Removed debug messages
2020-06-26 13:34:52 +03:00
d887d5dd70
Increased CopyLogRange performance
2020-06-26 13:34:35 +03:00
8f842a66e4
Merge pull request #3397 from xumengpanda/mengxu/fr-addPrefix-PR
...
Fast Restore: Support and test addPrefix and removePrefix feature
2020-06-25 14:06:39 -07:00
43d55fb73f
AtomicRestore:Fix typo in comments
2020-06-25 13:24:58 -07:00
2105778026
Merge pull request #3413 from MintYiqingchen/master
...
fix null point bug because omit calling createInstance
2020-06-25 10:57:38 -07:00
Andrew Noyes