557186ed17
Merge pull request #5909 from sfc-gh-jfu/jfu-cc-request-dbinfo
...
Change dbinfo broadcast to be explicitly requested by the worker registration message
2021-11-16 15:01:42 -08:00
8d6cfcb630
Merge pull request #6003 from sfc-gh-etschannen/fix-forwarding
...
fix: coordinators would process forwarding requests before making them durable
2021-11-16 14:24:21 -08:00
35bce4cd36
added a comment
2021-11-16 13:07:35 -08:00
fd635432c4
fix: coordinators would process forwarding requests before making them durable
2021-11-16 12:21:26 -08:00
4ae27a2a71
Merge pull request #5996 from sfc-gh-satherton/redwood-rename-v1
...
Rename redwood to mark it as v1 and some small tweaks.
2021-11-16 11:21:43 -08:00
76f0323873
Add missing declaration of test file.
2021-11-16 04:27:58 -08:00
21c3c585ca
Make file name parameter more user friendly in unit tests.
2021-11-16 04:03:11 -08:00
867999a41a
Rename wrong_format_version to unsupported_format_version.
2021-11-16 03:25:54 -08:00
7b29804a5e
Fix typo.
2021-11-16 02:30:57 -08:00
c53f5aa110
Renamed redwood to redwood-1-experimental and file extension to .redwood-v1.
2021-11-16 02:15:22 -08:00
4630b0ccea
Move DNS mock from SimExternalConnection to Sim2.
...
This is a revise PR of #5934 . In simulation, we don't have direct access to SimExternalConnection.
2021-11-15 17:02:51 -08:00
964d0209ca
Merge pull request #5637 from sfc-gh-ljoswiak/features/data-loss-prevention
...
Data loss protection when joining new cluster
2021-11-15 15:26:32 -08:00
3d26d2372b
Merge pull request #5932 from sfc-gh-ahusain/ahusain-improveTesterLogging
...
Improve tester actor logging to track workload run & check status
2021-11-15 13:28:55 -08:00
7c3c87ab82
Merge pull request #5935 from sfc-gh-qhoang/qhoang-mako-cleanup-temp-files
...
Remove mako temp shared memory file
2021-11-15 13:27:37 -08:00
02d0c43bc2
Merge pull request #5982 from sfc-gh-tclinkenbeard/improve-error-descriptions
...
Make snapshot errors more descriptive
2021-11-15 13:18:19 -08:00
7fd20a563f
Merge pull request #5987 from sfc-gh-etschannen/feature-changefeed-empty-versions
...
cleanup change feeds which have been completely removed from a storage server
2021-11-15 12:55:11 -08:00
6e81b83924
fix: cleanup change feeds which have been completely removed from a storage server
2021-11-15 11:47:42 -08:00
a546fb63ea
Merge pull request #5985 from sfc-gh-etschannen/feature-changefeed-empty-versions
...
Added a whenAtLeast function to change feeds to efficiently learn about empty versions
2021-11-15 10:51:28 -08:00
daf6dc22d4
Merge pull request #5959 from mpilman/features/apple-silicon-3
...
FDB compiles on Apple Sillicon
2021-11-15 11:21:28 -07:00
d7b5f9438a
Merge pull request #5972 from sfc-gh-ajbeamon/fix-client-threads-per-version-option-issues
...
Fix issues with setting CLIENT_THREADS_PER_VERSION option
2021-11-15 19:04:54 +01:00
94a51e57a5
Merge branch 'master' into feature-changefeed-empty-versions
...
# Conflicts:
# fdbclient/StorageServerInterface.h
2021-11-14 19:13:05 -08:00
6909754b21
changefeeds now have a whenAtLeast function for efficiently learning when the version has updated but no mutations have been committed
2021-11-14 19:08:46 -08:00
0ba77ea79b
Fix proxySnapCreate trace typo
2021-11-14 16:12:28 -08:00
dc756228f2
Make snapshot errors more descriptive
2021-11-14 13:46:17 -08:00
c8cbb03f51
Merge pull request #5978 from nblintao/only-snapshot
2021-11-12 16:20:43 -08:00
9422b8e5f2
Restricted getRangeAndFlatMap to snapshot
2021-11-12 15:12:37 -08:00
508429f30d
Redwood chunked file growth and low priority IO starvation prevention ( #5936 )
...
* Redwood files now growth in large page chunks controlled by a knob to reduce truncate() calls for expansion. PriorityMultiLock has limit on consecutive same-priority lock release. Increased Redwood max priority level to 3 for more separation at higher BTree levels.
* Simulation fix, don't mark certain IO timeout errors as injected unless the simulated process has been set to have an unreliable disk.
* Pager writes now truncate gradually upward, one chunk at a time, in response to writes, which wait on only the necessary truncate operations. Increased buggified chunk size because truncate can be very slow in simulation.
* In simulation, ioTimeoutError() and ioDegradedOrTimeoutError() will wait until at least the target timeout interval past the point when simulation is sped up.
* PriorityMultiLock::toString() prints more info and is now public.
* Added queued time to PriorityMultiLock.
* Bug fix to handle when speedUpSimulation changes later than the configured time.
* Refactored mutation application in leaf nodes to do fewer comparisons and do in place value updates if the new value is the same size as the old value.
* Renamed updatingInPlace to updatingDeltaTree for clarity. Inlined switchToLinearMerge() since it is only used in one place.
* Updated extendToCover to be more clear by passing in the old extension future as a parameter. Fixed initialization warning.
2021-11-12 13:47:07 -08:00
e752fdd69f
Optimization in FlowTransport's use of XXHash to avoid a malloc() when using the stream API and to not use the stream API when a message being sent is contiguous within a single packet buffer block. ( #5970 )
2021-11-12 11:45:21 -08:00
08fd69e787
Merge pull request #5967 from nblintao/flatmap-exception
2021-11-12 10:19:44 -08:00
019fd50f46
Merge pull request #5971 from Daniel-B-Smith/rocksdb-error-logging
...
Clean up RocksDB error logging
2021-11-12 13:17:10 -05:00
d129b726e1
Don't use assertion for bad option usage; don't disable local client until setup network is called.
2021-11-12 10:12:49 -08:00
82c3e8bf79
Trigger buildTeam operation if server transition from unhealthy -> healthy ( #5930 )
...
* Trigger buildTeam operation if server transition from unhealthy -> healthy
DataDistribution actor helps in building teams as server count changes
(add/removal), however, it is possible that total_healthy_server count
is insufficient to allow team formation. If happens, even healthy server
count recover, the buildTeam operation will not be triggered.
Patch proposal is to trigger `checkBuildTeam` operation if server
transitions from unhealthy -> healthy state. Incase system already
has created enough teams (desiredTeamCount/maxTeamCount), the operation
incurs a very minimal cost.
2021-11-12 09:41:01 -08:00
2d5f924278
GetKeyValuesAndFlatMap should return error if not retriable
2021-11-12 09:35:28 -08:00
9dccb0131e
Clean up RocksDB error logging
2021-11-12 12:14:12 -05:00
80d6debe14
Merge pull request #5966 from liquid-helium/pre-split-interfs
...
Interface for pre-split keyranges
2021-11-11 21:41:37 -08:00
d73d2144fd
Adjust distributorSplitRange order.
2021-11-11 20:28:55 -08:00
9f4a63dacf
Adjusted endpoints order to be compatible.
2021-11-11 17:45:08 -08:00
092af66198
Merge pull request #5965 from sfc-gh-anoyes/anoyes/fix-heap-use-after-free
...
Fix (test only) heap use after free
2021-11-11 17:27:12 -08:00
d9965e0e5a
Add DNS mock in SimExternalConnection.
...
This is a substep in supporting hostnames in cluster files. So that in simulation, we can add <hostname, ip addresses> mappings to mock DNS.
2021-11-11 17:05:05 -08:00
984bc0fbea
Added Endpoints.
2021-11-11 16:56:04 -08:00
5c9af1fdba
Remove unnecessary calls to Standalone::contents
2021-11-11 16:39:39 -08:00
ed46a81bbc
Fix (test only) heap use after free
2021-11-11 16:05:33 -08:00
6dcc7f8ef0
Merge pull request #5955 from nblintao/change-getKeyValuesAndFlatMap-endpoint-order
2021-11-11 09:07:16 -08:00
28dde27cb1
Fix Linux compiler errors
2021-11-11 08:49:51 -07:00
0e6dd46f5a
Correct code formatting
2021-11-11 08:38:25 -07:00
0dfb72176e
Merge pull request #5857 from sfc-gh-vgasiunas/notify-client-lib-changes
...
A mechanism to notify MVC about relevant client library status changes on the cluster
2021-11-11 07:43:20 -07:00
5af465aa29
FDB compiles on Apple Sillicon
2021-11-10 20:05:38 -07:00
e4c3f886da
Fix recovery issue
2021-11-10 16:15:13 -08:00
95aa3f9e00
Change SSI endpoints order to be consistent with 7.0
2021-11-10 14:22:06 -08:00
e0953c381d
Remove unused unit tests
2021-11-10 13:33:49 -08:00
Evan Tschannen