Commit Graph

76 Commits

Author SHA1 Message Date
Jingyu Zhou 5257bcdcf8 Update backup documentation with cluster recovery
Mainly replaces "Master" with "CC". Also changes branch from "master" to "main".
2022-01-18 11:37:11 -08:00
Ata E Husain Bohra 0858c6b6b9
Update recovery-internals documentation (#6229)
* Update recovery-internals documentation

Patch updates recovery-internals documentation to record changes
related to CC driving cluster-recovery state machine (earlier driven
by the master)
2022-01-11 13:20:20 -08:00
Jingyu Zhou a71712c985 Update txnStateStore doc with new CC initiated recovery
Also explains what is "txsPoppedVersion" and how it is used in recovery.
2022-01-07 13:29:31 -08:00
Ata E Husain Bohra 936bf5336a
Revert "Revert "Refactor: ClusterController driving cluster-recovery state machine" (#6191)
* Revert "Revert "Refactor: ClusterController driving cluster-recovery state machine""

Major changes includes:
1. Re-revert Sequencer refactor commits listed below (in listed order):
1.a. This reverts commit bb17e194d9.
1.b. This reverts commit d174bb2e06.
1.c. This reverts commit 30b05b469c.

2. Update Status.actor to track ClusterController interface to track
   recovery status.
3. Introduce a ServerKnob to define "cluster recovery trace event"
   prefix; for now keeping it as "Master", however, it should allow
   smooth transition to "Cluster" prefix as it seems more appropriate.
2022-01-06 12:15:51 -08:00
A.J. Beamon f24adc7b6a Fix a bunch of places where we used old-style arguments. Allow hyphens for profiler args. 2021-12-14 09:59:14 -08:00
Jingyu Zhou c913f89227 Address Markus's comments 2021-11-02 13:22:25 -07:00
Jingyu Zhou f6dc54ebbe Add transaction state store documentation
With code pointers.
2021-11-02 13:22:25 -07:00
sfc-gh-tclinkenbeard 8cc40e3a2b Expand use of BOOLEAN_PARAM 2021-07-02 21:41:50 -07:00
晓楚 254d7e235c fix typo 2021-06-28 11:14:55 +08:00
sfc-gh-tclinkenbeard 5c2d7b6080 Create RangeResult type alias 2021-05-03 13:14:16 -07:00
Xiaoge Su 6746bbaba7 Update the document per comments III 2021-03-22 10:36:45 -07:00
Xiaoge Su 924253da86 Update the documentation per comments II 2021-03-18 17:03:37 -07:00
Xiaoge Su 927c7993cc Update the documentation per comments 2021-03-18 13:27:02 -07:00
Xiaoge Su 7080ea1f1f Add document describes how a get/commit is done in FDB 2021-03-18 13:27:01 -07:00
Richard Chen ff4272aa2a add design markdown 2020-10-26 20:40:01 +00:00
Young Liu 5ba123493e resolve comments 2020-09-25 17:27:46 -07:00
Young Liu 3278e21b0b Change description of GRV proxy and Commit proxy in docs and add backward compatibility support for configuring proxies in fdbcli 2020-09-25 10:50:48 -07:00
Young Liu 35bef73a1c Rename proxy to commit proxy 2020-09-10 17:44:15 -07:00
Young Liu 79ce16650d merge master branch 2020-08-11 19:22:10 -07:00
Young Liu d6a23a4d6b Resolve comments to make GRV proxy a separate process class 2020-08-06 00:01:57 -07:00
Chaoguang Lin 3f4da830a2 Merge remote-tracking branch 'upstream/master' into add-management-api-into-special-key-space 2020-07-14 10:36:47 -07:00
bchavez ecf340da88
Corrects spelling mistakes in various markdown files. 2020-06-28 21:30:34 -07:00
Chaoguang Lin 59361cedaa Rename to have read and write impls and add set, clear, clearrange interfaces 2020-06-22 14:02:03 -07:00
Evan Tschannen 740d212a66
Merge pull request #3220 from sfc-gh-clin/add-traces-to-conflicting-keys-test
Fix nightly failure in ReportConflictingKeys test
2020-05-22 09:31:38 -07:00
Chaoguang Lin b73332d8a0 Fix typos in special-key-space doc 2020-05-21 16:29:55 -07:00
Andrew Noyes a2fd6d46a0 Cancel pending special key space reads on destroy
Previously the special key space would take a reference to the
transaction, but this doesn't make sense since the transaction might not
be refcounted
2020-05-21 17:37:11 +00:00
Chaoguang Lin 9034bf17c3 Add dd metrics doc 2020-05-20 16:21:22 -07:00
Chaoguang Lin e348caf654 Add module concept explanation into special-key-space documentation 2020-05-15 18:05:12 -07:00
Jingyu Zhou 9606a9f114 Minor format fix 2020-04-22 14:40:23 -07:00
Jingyu Zhou 74d8a2358d Add design doc for the new backup system
The new backup system introduces partitioned logs for storing mutations.
2020-04-22 14:26:06 -07:00
Jingyu Zhou 3f3a728bb3
Merge pull request #2970 from xumengpanda/mengxu/fr-range-versions-PR
Fix:New backup and restore: Mutations before min range version may not be complete
2020-04-19 09:49:07 -07:00
Meng Xu 0342a046bb FastRestore:Master:Use minRangeVersion to initialize rangeVersions 2020-04-17 09:32:19 -07:00
Meng Xu 9750d471d2 Design:Fix error in backup data format example 2020-04-16 21:42:01 -07:00
chaoguang 8219a8ea71 fix typo 2020-04-15 12:50:37 -07:00
chaoguang 022c53de9d Documentation for special-key-space 2020-04-15 12:26:16 -07:00
Alex Miller befcfcd395 Add design doc for TLog forward compatibility. 2020-04-12 17:51:21 -07:00
Alex Miller 56cca67c81 Fix a few markdown rendering issues in TLog spilling design doc. 2020-04-06 12:33:38 -07:00
Alex Miller 1547cbcef3 Finish TLog Spill-by-reference design doc, and incorporate feedback. 2020-04-05 23:43:23 -07:00
Alex Miller 0469750087 Merge remote-tracking branch 'upstream/master' into tlog-design-doc 2020-04-05 22:29:59 -07:00
Meng Xu e011f39829 FastRestore:Add sanity check and trace events 2020-01-23 16:03:41 -08:00
Bhaskar Muppana e1b5ef2672 Fixing minor inaccuracy in recovery internals design doc. 2019-12-27 10:14:25 -08:00
Jingyu Zhou 90d7db60a8 Change bullets back to paragraphs 2019-12-20 13:12:36 -08:00
Jingyu Zhou 861e23953c More formatting updates 2019-12-20 11:55:33 -08:00
Jingyu Zhou ac261f8f6a Reformat data distributor doc
Remove extra spaces and highlight code.
2019-12-20 11:51:11 -08:00
Jingyu Zhou 7adf444468 Apply review comment 2019-12-18 15:05:07 -08:00
Jingyu Zhou e6b942dccc Reorganize structure a bit 2019-12-18 15:00:43 -08:00
Jingyu Zhou 7debde6fda Some formatting changes, e.g., remove extra spaces 2019-12-16 15:55:51 -08:00
Jingyu Zhou a98b466f98 Add explanation of recovery version and copy data during recovery 2019-12-16 15:41:19 -08:00
Jingyu Zhou 5d1974539a
Merge pull request #2425 from xumengpanda/mengxu/doc-recovery-v2
Design doc: Recovery internals
2019-12-13 16:34:51 -08:00
Meng Xu a48bd841e4 Design doc:Recovery:Better define knownCommittedVersion
The definition of knownCommittedVersion is authored by Alex Miller;
The revision on which version of data SS should revert is based on
Jingyu Zhou's review comment.
2019-12-13 15:58:12 -08:00