Commit Graph

27247 Commits

Author SHA1 Message Date
Dan Lambright 9cd5090965 Raise visibility of gray failure actions 2024-04-16 12:23:16 -04:00
Jingyu Zhou 8b8b25a238
Merge pull request #11304 from hfu94/con
Add convert.py that converts between timestamp and version for clusters
2024-04-15 19:53:07 -07:00
hao fu b26cb205e0 Fix bug when there is no data in the first half of a binary search itereation 2024-04-15 14:08:52 -07:00
hao fu 4f2bdc72e9 Add convert.py that converts between timestamp and version for clusters 2024-04-15 14:06:14 -07:00
sulinehk b8081e2685 fix: golang docker compose example 2024-04-12 14:51:34 -05:00
Zhe Wang 832972e2da
Validate Mutation Version in Accumulative Checksum Framework (#11293)
* validate-mutation-version-in-acs-framework

* turn off knob

* randomly enable feature
2024-04-12 10:15:46 -07:00
Aaron Molitor 38bb833d41 updates to add fdb-kubernetes-monitor to the standard build flow 2024-04-12 08:31:48 -05:00
Sreenath Bodagala a4430b9169
Compare storage replicas on reads (#11235)
* - Compare storage replicas on reads (in "loadBalance()")

* - Do consistency check on reads in loadbalance

* - Do replica consistency check in the case where loadBalance issues
requests to multiple storage servers

* - Address a state variable related bug

* - Code formatting

* - API simplification

* - Simplify code

* - Code formatting

* - Address a review comment
2024-04-11 16:08:54 -04:00
Jingyu Zhou 2f50c4989f
Merge pull request #11287 from kakaiu:consistency-check-urgent-doc
Add consisteny check urgent doc
2024-04-09 12:07:53 -07:00
Zhe Wang c700f9ad5c improve 2024-04-08 16:16:18 -07:00
Zhe Wang 59681e4031 improve 2024-04-08 16:15:00 -07:00
Zhe Wang 0ace28e4a4 improve 2024-04-08 16:12:38 -07:00
Zhe Wang a3ef5d84bd fix escape char 2024-04-08 16:07:29 -07:00
Zhe Wang 2676f11856 address comments 2024-04-08 15:50:55 -07:00
Zhe Wang 4b0ea9902d fix 2024-04-08 14:08:42 -07:00
Zhe Wang 36d958470f add consisteny check urgent doc 2024-04-08 14:06:28 -07:00
Jingyu Zhou 34a3c778b7
Merge pull request #11285 from jzhou77/release-notes
Add 7.1.32 - 7.1.37 release notes
2024-04-08 13:58:07 -07:00
Jingyu Zhou c6988fff09 Add 7.1.32 - 7.1.37 release notes 2024-04-08 12:37:03 -07:00
Aaron Molitor 12fa060fb3
Update release-notes-730.rst 2024-04-08 10:16:21 -05:00
Jingyu Zhou 11cb531b31
Merge pull request #11280 from xis19/main
fixup! Update the document of Machine-Readable Status
2024-04-05 13:48:47 -07:00
Zhe Wang 33eecd0775
Real-time corruption detection with accumulative checksum (#11255)
* acs framework

* code refactor and fix bugs

* add ss crash loop protector

* use sharedptr instead of raw pointer

* fixed critical bugs and add provate mutation acs to the framework

* enable ACS for all mutations except for clear serverTag mutation and fix bugs

* fix restarting tests

* refactor code and fix bugs

* fix AccumulativeChecksumState toString

* fix bugs

* allow all mutations in acs and fixed bugs

* fix bugs and code cleanup

* code clean up for adding recovery support

* simplify code and support recovery

* clear acs state at ss

* fix bug

* terminate validator if ss will be removed in the current batch

* simplify code

* add trace

* address comments

* optimize code

* deep copy when adding mutation to acs validator

* warp encode and decode persist acs key

* make acstable private

* remove unless func

* remove unless func

* remove epoch in ACS validator

* add acs mutation counter in SS metrics

* code cleanup and make knob check better

* make mutation buffer global

* simplify code

* add comments

* make knob randomly set

* address comments

* ss reboot after acs mismatch found
2024-04-04 15:03:44 -07:00
Hao Fu 8635035cc5
Add destructor in LRU2 to release memory (#11276) 2024-04-03 17:26:41 -04:00
Hao Fu 2a774d39a5
Suppress ChosenMachine to fix simulation error (#11277) 2024-04-03 17:26:22 -04:00
Xiaoge Su 5b587d3c61 fixup! Update the document of Machine-Readable Status
The key has to be of byte type in Python, not str.
2024-04-03 13:22:33 -07:00
Hao Fu a6e543b5c7
fix signed int and overflow bugs (#11273)
now timestamp has uint64 and page number starts at 1
2024-04-01 18:33:50 -04:00
Aaron Molitor e0c6b6acff skip building fdb-kubernetes-monitor 2024-04-01 16:11:04 -04:00
Dan Lambright f3b2bca2c2
Fix detection of private mutations in version vector (#11268)
* Fix detection of private mutations in version vector

* add assertion that all tlogs receive changes to txn state in version vector

* Re-suppress version_vector upgrade tests

---------

Co-authored-by: Dan Lambright <hlambright@apple.com>
2024-04-01 15:20:32 -04:00
neethuhaneesha 3f5b60f711
Added perpetualStorageWiggleSpeed check to pick perpetualStoreType (#11272) 2024-04-01 11:30:18 -07:00
Jingyu Zhou 5c912b971e
Merge pull request #11266 from neethuhaneesha/direct_io
Add rocksdb direct_io knobs.
2024-03-27 14:56:09 -07:00
neethuhaneesha c96dcc74a7 Add rocksdb direct_io knobs. 2024-03-27 10:34:00 -07:00
Jingyu Zhou f05f014698
Merge pull request #11265 from danielpunkass/patch-1
Update README.md
2024-03-26 14:11:43 -07:00
Daniel Jalkut 382d3a25e1
Update README.md
Fix the spelling of Xcode and adjust grammar slightly.
2024-03-25 23:05:15 -04:00
Jingyu Zhou 8dbfd22b8b
Merge pull request #11263 from jzhou77/main
Add runRYWTransactionDebug()
2024-03-21 16:13:02 -07:00
Jingyu Zhou 59c20f7b18 Add runRYWTransactionDebug() 2024-03-21 13:54:57 -07:00
Jingyu Zhou a037415784
Merge pull request #11259 from kakaiu/release-note
Cherrypick release note from PR 11209
2024-03-21 13:13:39 -07:00
Dan Lambright 50f8eabfa3
Remove assertion equality in tcpvmap size on resolver return. (#11262) 2024-03-21 13:42:04 -04:00
Zhe Wang 9c788b9854 cherry-pick-pr-11209 2024-03-21 08:39:09 -07:00
Jingyu Zhou 8943393e84
Merge pull request #11254 from jzhou77/main
Add 7.3.28 to 7.3.31 release notes
2024-03-15 13:22:55 -07:00
Johannes Scheuermann 3643906535
Change the way how the fdb kubernetes monitor is copying files (#11109)
* Change the way how the fdb kubernetes monitor is copying files

* Add additional tests for the copy setup
2024-03-15 14:57:43 +01:00
Jingyu Zhou f73d2f17b2 Add 7.3.28 to 7.3.31 release notes 2024-03-14 20:20:36 -07:00
Yao Xiao de5cc85c28
block cache usage (#11251) 2024-03-14 16:15:38 -07:00
neethuhaneesha 77ff238874
Fixing setting perpetual_storage_wiggle_engine is considered as wrongly configured (#11250) 2024-03-14 11:52:29 -07:00
dependabot[bot] 0ccef7eb0f
Bump google.golang.org/protobuf in /fdbkubernetesmonitor (#11249)
Bumps google.golang.org/protobuf from 1.30.0 to 1.33.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-14 09:48:45 +01:00
Jingyu Zhou 1ed42ee658
Merge pull request #11236 from apple/fanout
Fix bug in which private mutations were detected incorrectly.
2024-03-13 10:59:32 -07:00
Dan Lambright fc17d76825 IGNORE vv upgrade tests 2024-03-13 11:32:46 -04:00
Dan Lambright fb219aee06 Revert "Remove vv upgrade tests until recovery fixed"
This reverts commit fbf3857094.
2024-03-13 10:55:30 -04:00
neethuhaneesha e26981a7a9
Added max range deletions before flush knob and some knob changes. (#11242) 2024-03-12 14:46:16 -07:00
Jingyu Zhou 5885e70a33
Merge pull request #11241 from jzhou77/main
Fix a DR corruption bug
2024-03-12 13:57:00 -07:00
Dan Lambright fbf3857094 Remove vv upgrade tests until recovery fixed 2024-03-12 16:38:25 -04:00
Zhe Wang b10c7107bb
Enable Accumulative Checksum in MutationRef (#11225)
* code clean up and add accumulative checksum bits to mutation ref

* address comments and fix issues

* address comments

* propagate acs index from commit proxy to storage server

* address comments

* address comments

* address comments

* address comments
2024-03-11 09:51:31 -07:00