Commit Graph

141 Commits

Author SHA1 Message Date
Xiaoxi Wang 2b2bc12cc1 Update Document; set log limit 2022-08-08 10:04:48 -07:00
Xiaoxi Wang 3252d420a2 rename DDQueue; add ServerCounter 2022-08-05 12:01:11 -07:00
sfc-gh-tclinkenbeard 1bd47a07b2 Add ENFORCE_TAG_THROTTLING_ON_PROXIES knob 2022-08-05 00:40:10 -07:00
sfc-gh-tclinkenbeard f33b514e0b Update status section of global-tag-throttling.md 2022-08-02 16:53:03 -07:00
Trevor Clinkenbeard edf4e60fa9
Merge pull request #7631 from sfc-gh-tclinkenbeard/global-tag-throttling5
Improvements to `GlobalTagThrottler`
2022-08-02 16:04:20 -07:00
Jingyu Zhou e8baba8009
Merge pull request #7575 from xis19/lb
Notes on Load Balancer
2022-07-19 17:50:25 -07:00
sfc-gh-tclinkenbeard 8d2cde32d9 Added global-tag-throttling.md 2022-07-19 17:04:04 -07:00
Xiaoxi Wang 9dfd58978f
Apply suggestions from code review
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2022-07-19 12:03:49 -07:00
Xiaoge Su bb05c83e19 fixup! Update documentation per comments 2022-07-15 17:21:41 -07:00
Xiaoge Su 6e7716d078
Update design/LoadBalancing/LoadBalancing.md
Co-authored-by: Zhe Wu <halfprice@users.noreply.github.com>
2022-07-14 11:42:20 -07:00
Xiaoge Su 3b50a4c410
Update design/LoadBalancing/LoadBalancing.md
Co-authored-by: Zhe Wu <halfprice@users.noreply.github.com>
2022-07-14 11:26:55 -07:00
Xiaoxi Wang 69c4da81d3 update data distributor design doc 2022-07-12 14:08:19 -07:00
Xiaoge Su 46b98a5e20 Notes on Load Balancer 2022-07-12 03:00:36 -07:00
Ata E Husain Bohra 643c0004c7
FDB Encryption data at-rest design documentation (#6629)
* FDB Encryption data at-rest design documentation

Patch details FDB Encryption data at-rest design documentation
2022-03-28 16:37:00 -07:00
Bharadwaj V.R 7cb5c8957c Change dd doc to match recent encapsulation changes to TC data structures 2022-03-12 17:30:50 -04:00
Jingyu Zhou 5257bcdcf8 Update backup documentation with cluster recovery
Mainly replaces "Master" with "CC". Also changes branch from "master" to "main".
2022-01-18 11:37:11 -08:00
Ata E Husain Bohra 0858c6b6b9
Update recovery-internals documentation (#6229)
* Update recovery-internals documentation

Patch updates recovery-internals documentation to record changes
related to CC driving cluster-recovery state machine (earlier driven
by the master)
2022-01-11 13:20:20 -08:00
Jingyu Zhou a71712c985 Update txnStateStore doc with new CC initiated recovery
Also explains what is "txsPoppedVersion" and how it is used in recovery.
2022-01-07 13:29:31 -08:00
Ata E Husain Bohra 936bf5336a
Revert "Revert "Refactor: ClusterController driving cluster-recovery state machine" (#6191)
* Revert "Revert "Refactor: ClusterController driving cluster-recovery state machine""

Major changes includes:
1. Re-revert Sequencer refactor commits listed below (in listed order):
1.a. This reverts commit bb17e194d9.
1.b. This reverts commit d174bb2e06.
1.c. This reverts commit 30b05b469c.

2. Update Status.actor to track ClusterController interface to track
   recovery status.
3. Introduce a ServerKnob to define "cluster recovery trace event"
   prefix; for now keeping it as "Master", however, it should allow
   smooth transition to "Cluster" prefix as it seems more appropriate.
2022-01-06 12:15:51 -08:00
A.J. Beamon f24adc7b6a Fix a bunch of places where we used old-style arguments. Allow hyphens for profiler args. 2021-12-14 09:59:14 -08:00
Jingyu Zhou c913f89227 Address Markus's comments 2021-11-02 13:22:25 -07:00
Jingyu Zhou f6dc54ebbe Add transaction state store documentation
With code pointers.
2021-11-02 13:22:25 -07:00
sfc-gh-tclinkenbeard 8cc40e3a2b Expand use of BOOLEAN_PARAM 2021-07-02 21:41:50 -07:00
晓楚 254d7e235c fix typo 2021-06-28 11:14:55 +08:00
sfc-gh-tclinkenbeard 5c2d7b6080 Create RangeResult type alias 2021-05-03 13:14:16 -07:00
Xiaoge Su 6746bbaba7 Update the document per comments III 2021-03-22 10:36:45 -07:00
Xiaoge Su 924253da86 Update the documentation per comments II 2021-03-18 17:03:37 -07:00
Xiaoge Su 927c7993cc Update the documentation per comments 2021-03-18 13:27:02 -07:00
Xiaoge Su 7080ea1f1f Add document describes how a get/commit is done in FDB 2021-03-18 13:27:01 -07:00
Richard Chen ff4272aa2a add design markdown 2020-10-26 20:40:01 +00:00
Young Liu 5ba123493e resolve comments 2020-09-25 17:27:46 -07:00
Young Liu 3278e21b0b Change description of GRV proxy and Commit proxy in docs and add backward compatibility support for configuring proxies in fdbcli 2020-09-25 10:50:48 -07:00
Young Liu 35bef73a1c Rename proxy to commit proxy 2020-09-10 17:44:15 -07:00
Young Liu 79ce16650d merge master branch 2020-08-11 19:22:10 -07:00
Young Liu d6a23a4d6b Resolve comments to make GRV proxy a separate process class 2020-08-06 00:01:57 -07:00
Chaoguang Lin 3f4da830a2 Merge remote-tracking branch 'upstream/master' into add-management-api-into-special-key-space 2020-07-14 10:36:47 -07:00
bchavez ecf340da88
Corrects spelling mistakes in various markdown files. 2020-06-28 21:30:34 -07:00
Chaoguang Lin 59361cedaa Rename to have read and write impls and add set, clear, clearrange interfaces 2020-06-22 14:02:03 -07:00
Evan Tschannen 740d212a66
Merge pull request #3220 from sfc-gh-clin/add-traces-to-conflicting-keys-test
Fix nightly failure in ReportConflictingKeys test
2020-05-22 09:31:38 -07:00
Chaoguang Lin b73332d8a0 Fix typos in special-key-space doc 2020-05-21 16:29:55 -07:00
Andrew Noyes a2fd6d46a0 Cancel pending special key space reads on destroy
Previously the special key space would take a reference to the
transaction, but this doesn't make sense since the transaction might not
be refcounted
2020-05-21 17:37:11 +00:00
Chaoguang Lin 9034bf17c3 Add dd metrics doc 2020-05-20 16:21:22 -07:00
Chaoguang Lin e348caf654 Add module concept explanation into special-key-space documentation 2020-05-15 18:05:12 -07:00
Jingyu Zhou 9606a9f114 Minor format fix 2020-04-22 14:40:23 -07:00
Jingyu Zhou 74d8a2358d Add design doc for the new backup system
The new backup system introduces partitioned logs for storing mutations.
2020-04-22 14:26:06 -07:00
Jingyu Zhou 3f3a728bb3
Merge pull request #2970 from xumengpanda/mengxu/fr-range-versions-PR
Fix:New backup and restore: Mutations before min range version may not be complete
2020-04-19 09:49:07 -07:00
Meng Xu 0342a046bb FastRestore:Master:Use minRangeVersion to initialize rangeVersions 2020-04-17 09:32:19 -07:00
Meng Xu 9750d471d2 Design:Fix error in backup data format example 2020-04-16 21:42:01 -07:00
chaoguang 8219a8ea71 fix typo 2020-04-15 12:50:37 -07:00
chaoguang 022c53de9d Documentation for special-key-space 2020-04-15 12:26:16 -07:00
Alex Miller befcfcd395 Add design doc for TLog forward compatibility. 2020-04-12 17:51:21 -07:00
Alex Miller 56cca67c81 Fix a few markdown rendering issues in TLog spilling design doc. 2020-04-06 12:33:38 -07:00
Alex Miller 1547cbcef3 Finish TLog Spill-by-reference design doc, and incorporate feedback. 2020-04-05 23:43:23 -07:00
Alex Miller 0469750087 Merge remote-tracking branch 'upstream/master' into tlog-design-doc 2020-04-05 22:29:59 -07:00
Meng Xu e011f39829 FastRestore:Add sanity check and trace events 2020-01-23 16:03:41 -08:00
Bhaskar Muppana e1b5ef2672 Fixing minor inaccuracy in recovery internals design doc. 2019-12-27 10:14:25 -08:00
Jingyu Zhou 90d7db60a8 Change bullets back to paragraphs 2019-12-20 13:12:36 -08:00
Jingyu Zhou 861e23953c More formatting updates 2019-12-20 11:55:33 -08:00
Jingyu Zhou ac261f8f6a Reformat data distributor doc
Remove extra spaces and highlight code.
2019-12-20 11:51:11 -08:00
Jingyu Zhou 7adf444468 Apply review comment 2019-12-18 15:05:07 -08:00
Jingyu Zhou e6b942dccc Reorganize structure a bit 2019-12-18 15:00:43 -08:00
Jingyu Zhou 7debde6fda Some formatting changes, e.g., remove extra spaces 2019-12-16 15:55:51 -08:00
Jingyu Zhou a98b466f98 Add explanation of recovery version and copy data during recovery 2019-12-16 15:41:19 -08:00
Jingyu Zhou 5d1974539a
Merge pull request #2425 from xumengpanda/mengxu/doc-recovery-v2
Design doc: Recovery internals
2019-12-13 16:34:51 -08:00
Meng Xu a48bd841e4 Design doc:Recovery:Better define knownCommittedVersion
The definition of knownCommittedVersion is authored by Alex Miller;
The revision on which version of data SS should revert is based on
Jingyu Zhou's review comment.
2019-12-13 15:58:12 -08:00
Meng Xu feb38be413 Design doc:Recovery internal: mark code as code style
which is suggested by Jingyu Zhou.
2019-12-11 16:57:41 -08:00
Meng Xu e73fc515bd Resolve review comments and suggestions from A.J. Beamon and Markus Pilman 2019-12-10 14:48:39 -08:00
Meng Xu 1a6864de42 Resolve review comments from Neelam Goyal and Jingyu Zhou 2019-12-09 22:47:20 -08:00
Meng Xu a13ccbbba2 Design doc: Rename data distribution design file 2019-12-09 06:44:57 -08:00
Meng Xu a81a4f8179 Design doc: Recovery internals 2019-12-08 22:39:00 -08:00
Meng Xu 79ebd81dab Design doc:DD:Fix typos 2019-11-22 16:20:08 -08:00
Meng Xu 8e04263191 Design doc:DD:Revision
Correct typos and add minor claification changes as suggested by
Xin Dong and Jon Fu in the review.
2019-11-22 16:13:06 -08:00
Meng Xu a0e5f25423 Doc:How does DD work
Describe how data distribution is implemented.
2019-11-14 11:53:38 -08:00
Alex Miller 61f6aed193 Remove the header meant for the forums 2019-09-10 17:40:56 -07:00
Alex Miller ce4393b4be Add design doc on TLog spilling 2019-09-10 17:37:23 -07:00
Meng Xu 15bfadbce4 Design: Backup data format: Add endianness discussion 2019-05-30 17:06:53 -07:00
Meng Xu 7ff54290a2 Design:Backup format: Fix types 2019-05-30 17:06:53 -07:00
Meng Xu 1acff2fdb7 Design:Backup data format 2019-05-30 17:06:53 -07:00
Alec Grieser bb43d97aaa
Fixes #1103: Incorrect nested example in design/tuple.md 2019-02-28 13:13:30 -08:00
Meng Xu cd873831ec
Update backup.md
Incorporate review comments to change the phrases in a sentence.
2018-10-29 14:11:20 -07:00
Meng Xu b269b85f3e doc: clarify the backup document
Correct small confusion and typos in backup document.

Signed-off-by: Meng Xu <meng_xu@apple.com>
2018-10-05 15:02:38 -07:00
Bhaskar Muppana 6d3a514fe2 Backup design documentation. 2018-02-22 18:09:41 -08:00
Alec Grieser 929fa5699a tuple and versionstamp documentation updates 2017-10-24 17:53:16 -07:00
Alec Grieser fc97fa3c8d added documentation for versionstamped tuples to python docs 2017-10-10 09:12:42 -07:00
Ben Collins 8c13f60625 Update tuple.md 2017-09-19 22:41:55 +00:00
Alec Grieser 9e2b0debcd made emboldening and capitalization consistent 2017-08-25 11:43:13 -07:00
Alec Grieser 9b10fb627c capitalize DEPRECATED 2017-08-25 11:39:08 -07:00
Alec Grieser fef18ee0a3 worked through some formatting issues 2017-08-25 11:38:21 -07:00
Alec Grieser 850ab5b64e MOAR NEWLINES 2017-08-25 11:36:33 -07:00
Alec Grieser 833c388d89 tried adding some newlines 2017-08-25 11:34:06 -07:00
Alec Grieser 9be6348580 added tuple spec to design section of repo 2017-08-25 11:30:46 -07:00