Commit Graph

29 Commits

Author SHA1 Message Date
Meng Xu 3aa92286aa FastRestore:Fix segmentation fault 2020-09-29 22:28:52 -07:00
Meng Xu 262307d557 FR:Change applierRemainMB map to unordered_map 2020-09-23 15:39:01 -07:00
Meng Xu 08e243a07e Fix assert failure at addCallbackAndDelFutureRef 2020-09-22 15:41:07 -07:00
Meng Xu f8c5d85b79 FastRestore:Catch controller error and fix unhandled error occurred in updateHeartbeatTime 2020-09-22 13:32:26 -07:00
Meng Xu 002b1bec4c FastRestore:Control write traffic at each applier
Controller assigns each applier a write rate.
Applier keeps the write-rate worth of transactions outstanding to DB.

This is to avoid heavily overloading DB while still keep enough
traffic to DB to get a good write throughput.
2020-09-22 08:14:28 -07:00
Young Liu 6032a21d30 Fix comment 2020-09-17 18:02:23 -07:00
Young Liu 60ccaa2ae9 Support finding max restorable version for key ranges when keyspace's max restorable version is unavailable 2020-09-17 17:58:58 -07:00
Young Liu d4e3e98957 Use new getRestoreSet in RestoreController 2020-09-17 17:56:36 -07:00
Young Liu 71309a79f9 Merge branch 'release-6.3' into range 2020-09-17 17:54:33 -07:00
Meng Xu 8224e17a08 Integrate extended getRestoreSet API into fast restore
The extended getRestoreSet provides a much smaller set of backup files for small keyrange restore;
This commit integrate it into fast restore so that fast restore does not have to filter out unneeded backup files.
2020-09-15 09:38:43 -07:00
Meng Xu fc01b7558c FastRestore:fix uninitialized variable in param.asset 2020-09-06 22:40:57 -07:00
Evan Tschannen 53def68946 fix compiler warning 2020-08-31 01:23:47 -07:00
Meng Xu ca486fdcd4 FastRestoreOldBackupTest:Revert workload time to 30s 2020-08-27 09:31:57 -07:00
Meng Xu 7b7490efe7 FastRestore:Debug trace for seg fault 2020-08-17 20:34:33 -07:00
Xin Dong ce05bb2a26
Merge pull request #3617 from xumengpanda/tmp/trace-PR
Resolve throttling events
2020-08-13 16:31:55 -07:00
Meng Xu 0d0efcfce7 FR:Fix incorrect ASSERT:batchIndex starts at 1 instead of 0 2020-08-12 10:36:31 -07:00
Meng Xu 97e49f2f70 Resolve throttling events 2020-08-10 22:01:12 -07:00
Meng Xu c89a62b935 FR:SampleBackup:Assert req.batchIndex < controller batch size 2020-08-07 16:52:07 -07:00
Meng Xu c27542d4e9 FR:SampleBackup:Send reply when receive duplicate msg 2020-08-07 16:50:36 -07:00
Meng Xu 859c3145e2 FR:Fix samples not send reply and false positive failures 2020-08-05 11:32:04 -07:00
Meng Xu 309f383be3 FR:Report error if controller throws error 2020-08-04 23:08:41 -07:00
Meng Xu 879998d01b FR:fix compilation error 2020-08-04 23:04:38 -07:00
Meng Xu 7992cef025 FR:Fix sample network pkg can be too big 2020-08-04 22:35:21 -07:00
Meng Xu e9adec421d FR:Add controller interface and send to roles 2020-08-03 15:06:15 -07:00
Meng Xu 0c49646486 Fix:FastRestore:rangeVersion must be 0 when no range file is used
otherwise, all mutations will be ignored by loaders as old mutations
2020-07-31 23:23:17 -07:00
Meng Xu 2f5293fcc7 Introduce knob FASTRESTORE_USE_LOG_FILE and FASTRESTORE_USE_RANGE_FILE 2020-07-31 10:40:29 -07:00
Meng Xu 99d8399f4e FastRestore:Add trace for file size and bc progress 2020-07-25 19:12:25 -07:00
Meng Xu d161d8f298 Merge branch 'release-6.3' into mengxu/fr-rename-master-PR 2020-07-16 16:46:32 -07:00
Meng Xu 8cffd30951 FastRestore:Replace master word with controller 2020-07-16 16:37:13 -07:00