Commit Graph

1669 Commits

Author SHA1 Message Date
Josh Slocum 962a1aaf74 Fix race in configure database storage migration test 2021-10-27 11:38:15 -05:00
Evan Tschannen 2208b04174
Merge pull request #5855 from sfc-gh-etschannen/blob_full_clean
Blob Granules V0
2021-10-26 09:57:35 -07:00
Lukas Joswiak 92998fd20b Merge rollback message into rollforward message 2021-10-25 12:03:22 -07:00
Josh Slocum 0ff8ddc2b6 Merge branch 'master' into blob_full_clean 2021-10-25 13:38:48 -05:00
Evan Tschannen 6f7558b8ea Merge branch 'master' of https://github.com/apple/foundationdb into feature-range-feed
# Conflicts:
#	tests/CMakeLists.txt
2021-10-24 21:06:33 -07:00
A.J. Beamon e882eb33fc Abstract the cluster file into a cluster connection record that can be backed by something other than the filesystem. 2021-10-22 11:05:18 -07:00
Josh Slocum 773886515e Merge branch 'feature-range-feed' into blob_full_clean 2021-10-22 11:07:51 -05:00
Evan Tschannen 3f7df58a77 fixed a number of issues 2021-10-19 13:56:52 -07:00
Josh Slocum 912ef76f1c cleanup before merge 2021-10-18 17:11:14 -05:00
Suraj Gupta e2e852e515 Mitigate transitive includes. 2021-10-18 10:49:25 -04:00
He Liu a0f62e873e Use ErrorOr to indicate an error. 2021-10-15 14:58:26 -07:00
He Liu 8e7a4c587e Merge branch 'master' of https://github.com/apple/foundationdb into clean-sim-test-data-loss 2021-10-15 14:22:08 -07:00
Suraj Gupta 1c8d96aea3 Ensure non-zero BW processes when gate is enabled. 2021-10-14 19:06:02 -04:00
He Liu dbfeb06c97 Reproduced user data loss incident, and tested the improved exclude tool
can fix the system metadata.
2021-10-14 14:08:39 -07:00
Josh Slocum b5074fd597 Reworked all of the system data to encode granule data more efficiently for persistence 2021-10-13 16:28:04 -05:00
Josh Slocum f3c44c568f fixing merge conflicts 2021-10-13 16:26:44 -05:00
Josh Slocum 5f0ec0612a Merge branch 'feature-range-feed' into blob_full 2021-10-13 15:44:35 -05:00
Suraj Gupta 2ec8781224 Merge knobs into one. 2021-10-13 14:00:37 -04:00
Suraj Gupta 9d4b55c7fe Gate the blob verifier as well. 2021-10-13 11:45:51 -04:00
Suraj Gupta 5a6a052c55 Add a knob to gate blob-related work. 2021-10-13 09:48:02 -04:00
Evan Tschannen d51edf18dc fixed merge conflicts 2021-10-09 19:47:24 -07:00
Evan Tschannen 5c642f706e Merge branch 'master' of https://github.com/apple/foundationdb into feature-range-feed
# Conflicts:
#	fdbcli/fdbcli.actor.cpp
2021-10-09 19:34:16 -07:00
Suraj Gupta 95166796cd Address PR comments. 2021-10-04 20:16:22 -04:00
Suraj Gupta 4d54669ccd Recruit the blob workers via blob manager.
In this PR, the blob manager now recruits blob workers
(via communication with the cluster controller). Blob workers
are onboarded as blob worker processes enter the cluster.
2021-10-04 11:07:08 -04:00
Steve Atherton ee6d9b33e9
Merge pull request #5691 from sfc-gh-satherton/redwood-reporting-changes
Redwood now reports space used to store metadata about free space as free space
2021-09-30 11:06:45 -07:00
Neethu Haneesha Bingi d2681dd7aa Simulation changes to test perpetual_storage_wiggle_locality configuration. 2021-09-30 10:00:33 -07:00
Steve Atherton d7a420a8d1 Added Redwood pager and BTree overview statistics to trace events logged on creation and recovery. Changed getStorageBytes() to treat internal space used by free list queues as reusable. 2021-09-29 21:01:21 -07:00
Josh Slocum a986679b7f More bug fixes 2021-09-24 10:02:02 -05:00
Suraj Gupta 5fa6c687d6 Add blob manager as a singleton. 2021-09-23 10:45:37 -04:00
Xiaoxi Wang 1730d75f73 change configure test
add store type check
add test file
2021-09-21 18:11:04 -07:00
Chaoguang Lin b188e289d3 Format code 2021-09-21 10:06:04 -07:00
Chaoguang Lin 65956ae6b7 Refactor configure command; refactor changeConfig to template code to reuse existing tests 2021-09-21 10:06:04 -07:00
Vaidas Gasiunas 16171d8252 Refactoring well-known endpoint registration
- List all well-known endpoints of FDB in a single enum
- Identify well-known endpoints by plain IDs
2021-09-21 11:05:31 -06:00
Xiaoxi Wang cc72c5e23c fix compilation error 2021-09-20 23:57:45 -07:00
Evan Tschannen ef302d33f5 added a comment 2021-09-20 13:58:05 -07:00
Evan Tschannen 8926951a0a restore the original tssMode in restarting tests 2021-09-20 13:58:05 -07:00
Evan Tschannen 2da7732637 added a new workload to test streaming reads 2021-09-20 13:58:05 -07:00
Markus Pilman 2a0415e640 Fix error handling when locking database 2021-09-17 11:33:51 -07:00
Xiaoge Su abf73047ca Enforce std:: specifier rather than using namespace 2021-09-16 19:40:28 -07:00
Josh Slocum 57176a4955 Increasing workload request count 2021-09-16 10:03:30 -05:00
Josh Slocum c9b8bdffbe Passes a single correctness test! 2021-09-15 17:18:04 -05:00
Chaoguang Lin 325a7881f4 Clang-format fdbserver/workloads/SpecialKeySpaceCorrectness.actor.cpp 2021-09-13 13:28:48 -07:00
Chaoguang Lin cfb9b56067 Refactor lock/unlock command, fix the related correctness test, add the documentation for updating usage of the special key 2021-09-13 13:28:48 -07:00
Josh Slocum c2d1d1704f Merge branch 'feature-range-feed' into blob_full 2021-09-10 11:21:52 -05:00
Evan Tschannen ac5b580e2d Merge branch 'master' into feature-range-feed
# Conflicts:
#	fdbcli/fdbcli.actor.cpp
#	fdbclient/StorageServerInterface.cpp
#	fdbclient/StorageServerInterface.h
#	fdbserver/ApplyMetadataMutation.cpp
#	fdbserver/TLogServer.actor.cpp
#	flow/error_definitions.h
2021-09-09 23:13:22 -07:00
Josh Slocum eb76343dfb Added blob granule reassignment and splitting 2021-09-08 14:09:14 -05:00
Evan Tschannen 9fefd59076 Fixed a number of bugs, change feeds are correctness clean with the current workload 2021-09-05 18:17:23 -07:00
Evan Tschannen 367c7cda92 fixed problems with the change feed workload 2021-09-03 15:14:28 -07:00
Evan Tschannen b02e8d99c6 added a workload to test change feeds 2021-09-03 14:19:27 -07:00
Chaoguang Lin 2aa0a5cf58 The lock special key has the lock UID as the value 2021-09-03 12:15:56 -07:00