fd707c6d7e
Tests for "Restricted getRangeAndFlatMap to snapshot #5978" ( #5980 )
2021-11-16 19:44:35 -08:00
867ad8be46
Merge branch 'bit-flipping-workload' of github.com:sfc-gh-ngoyal/foundationdb into bit-flipping-workload
2021-11-16 18:12:18 -08:00
6e43dde613
Fixed bad merge resolution.
2021-11-16 18:04:37 -08:00
b2019cd4f2
Merge pull request #5992 from sfc-gh-mpilman/features/fmt
...
added fmt dependency to flow
2021-11-16 18:58:55 -07:00
725d31e264
Fix parameters passes to simulatedMachine().
2021-11-16 17:50:12 -08:00
ce112e1f23
Enhance trace event.
2021-11-16 17:39:59 -08:00
fc08313925
Use path relative to Python binary
2021-11-16 16:36:44 -08:00
8d4ec8562d
Move generated versions.target file to build directory
2021-11-16 16:36:44 -08:00
8f6934c4d0
Merge branch 'master' of github.com:apple/foundationdb into jfu-fix-ss-segfault
2021-11-16 18:03:32 -05:00
557186ed17
Merge pull request #5909 from sfc-gh-jfu/jfu-cc-request-dbinfo
...
Change dbinfo broadcast to be explicitly requested by the worker registration message
2021-11-16 15:01:42 -08:00
035e0d6e52
Merge branch 'master' into bit-flipping-workload
2021-11-16 14:42:22 -08:00
8d6cfcb630
Merge pull request #6003 from sfc-gh-etschannen/fix-forwarding
...
fix: coordinators would process forwarding requests before making them durable
2021-11-16 14:24:21 -08:00
e04526b345
Allow knobs to be set via network options before network is setup
2021-11-16 13:47:37 -08:00
35bce4cd36
added a comment
2021-11-16 13:07:35 -08:00
fd635432c4
fix: coordinators would process forwarding requests before making them durable
2021-11-16 12:21:26 -08:00
4ae27a2a71
Merge pull request #5996 from sfc-gh-satherton/redwood-rename-v1
...
Rename redwood to mark it as v1 and some small tweaks.
2021-11-16 11:21:43 -08:00
b1633b90f1
Added fmt to flow
2021-11-16 12:03:49 -07:00
8ae49c18eb
Add assertion to IKnobCollection::setGlobalKnobCollection
2021-11-16 10:41:46 -08:00
3b1ae39403
Add CLIOptions::setupKnobs method
2021-11-16 10:39:22 -08:00
dba0a2d729
Add comment to clarify empty UID usage.
2021-11-16 08:49:16 -06:00
1817b135ac
Use a local keyRangeMap to avoid assigning ranges not part of client ranges.
2021-11-16 08:49:16 -06:00
ac0a5750e7
Clamp end of system keys down to normal keys.
2021-11-16 08:49:16 -06:00
76f0323873
Add missing declaration of test file.
2021-11-16 04:27:58 -08:00
21c3c585ca
Make file name parameter more user friendly in unit tests.
2021-11-16 04:03:11 -08:00
867999a41a
Rename wrong_format_version to unsupported_format_version.
2021-11-16 03:25:54 -08:00
7b29804a5e
Fix typo.
2021-11-16 02:30:57 -08:00
c53f5aa110
Renamed redwood to redwood-1-experimental and file extension to .redwood-v1.
2021-11-16 02:15:22 -08:00
deb0eb85e8
Initialize global flow knobs in setupNetwork
2021-11-16 00:41:34 -08:00
4630b0ccea
Move DNS mock from SimExternalConnection to Sim2.
...
This is a revise PR of #5934 . In simulation, we don't have direct access to SimExternalConnection.
2021-11-15 17:02:51 -08:00
964d0209ca
Merge pull request #5637 from sfc-gh-ljoswiak/features/data-loss-prevention
...
Data loss protection when joining new cluster
2021-11-15 15:26:32 -08:00
3d26d2372b
Merge pull request #5932 from sfc-gh-ahusain/ahusain-improveTesterLogging
...
Improve tester actor logging to track workload run & check status
2021-11-15 13:28:55 -08:00
7c3c87ab82
Merge pull request #5935 from sfc-gh-qhoang/qhoang-mako-cleanup-temp-files
...
Remove mako temp shared memory file
2021-11-15 13:27:37 -08:00
02d0c43bc2
Merge pull request #5982 from sfc-gh-tclinkenbeard/improve-error-descriptions
...
Make snapshot errors more descriptive
2021-11-15 13:18:19 -08:00
f140028086
Merge branch 'master' into blob_integration
2021-11-15 15:09:40 -06:00
7fd20a563f
Merge pull request #5987 from sfc-gh-etschannen/feature-changefeed-empty-versions
...
cleanup change feeds which have been completely removed from a storage server
2021-11-15 12:55:11 -08:00
6e81b83924
fix: cleanup change feeds which have been completely removed from a storage server
2021-11-15 11:47:42 -08:00
a546fb63ea
Merge pull request #5985 from sfc-gh-etschannen/feature-changefeed-empty-versions
...
Added a whenAtLeast function to change feeds to efficiently learn about empty versions
2021-11-15 10:51:28 -08:00
1d1f3fe747
changing assert for now
2021-11-15 12:24:51 -06:00
daf6dc22d4
Merge pull request #5959 from mpilman/features/apple-silicon-3
...
FDB compiles on Apple Sillicon
2021-11-15 11:21:28 -07:00
d7b5f9438a
Merge pull request #5972 from sfc-gh-ajbeamon/fix-client-threads-per-version-option-issues
...
Fix issues with setting CLIENT_THREADS_PER_VERSION option
2021-11-15 19:04:54 +01:00
3f1e7da5c9
Merge pull request #5986 from sfc-gh-jslocum/cf_fetch_race_fix
...
Added fetch version to change feeds to avoid races and overwrites bet…
2021-11-15 09:47:44 -08:00
fd4f13fba1
Added fetch version to change feeds to avoid races and overwrites between updateStorage and fetchChangeFeed
2021-11-15 09:49:51 -06:00
94a51e57a5
Merge branch 'master' into feature-changefeed-empty-versions
...
# Conflicts:
# fdbclient/StorageServerInterface.h
2021-11-14 19:13:05 -08:00
6909754b21
changefeeds now have a whenAtLeast function for efficiently learning when the version has updated but no mutations have been committed
2021-11-14 19:08:46 -08:00
0ba77ea79b
Fix proxySnapCreate trace typo
2021-11-14 16:12:28 -08:00
dc756228f2
Make snapshot errors more descriptive
2021-11-14 13:46:17 -08:00
c8cbb03f51
Merge pull request #5978 from nblintao/only-snapshot
2021-11-12 16:20:43 -08:00
9422b8e5f2
Restricted getRangeAndFlatMap to snapshot
2021-11-12 15:12:37 -08:00
508429f30d
Redwood chunked file growth and low priority IO starvation prevention ( #5936 )
...
* Redwood files now growth in large page chunks controlled by a knob to reduce truncate() calls for expansion. PriorityMultiLock has limit on consecutive same-priority lock release. Increased Redwood max priority level to 3 for more separation at higher BTree levels.
* Simulation fix, don't mark certain IO timeout errors as injected unless the simulated process has been set to have an unreliable disk.
* Pager writes now truncate gradually upward, one chunk at a time, in response to writes, which wait on only the necessary truncate operations. Increased buggified chunk size because truncate can be very slow in simulation.
* In simulation, ioTimeoutError() and ioDegradedOrTimeoutError() will wait until at least the target timeout interval past the point when simulation is sped up.
* PriorityMultiLock::toString() prints more info and is now public.
* Added queued time to PriorityMultiLock.
* Bug fix to handle when speedUpSimulation changes later than the configured time.
* Refactored mutation application in leaf nodes to do fewer comparisons and do in place value updates if the new value is the same size as the old value.
* Renamed updatingInPlace to updatingDeltaTree for clarity. Inlined switchToLinearMerge() since it is only used in one place.
* Updated extendToCover to be more clear by passing in the old extension future as a parameter. Fixed initialization warning.
2021-11-12 13:47:07 -08:00
2f2e5219da
Move the config file scheme into a separate package so it can be imported by the operator.
...
Move the argument for the number of servers per pod into a command-line argument so we can use the same config file at different storage server densities.
2021-11-12 11:58:38 -08:00
Tao Lin