Commit Graph

18262 Commits

Author SHA1 Message Date
Renxuan Wang 46d17d748f Change member variable fromHostname to type bool.
So that it can be serialized.
2021-11-23 14:25:02 -10:00
Evan Tschannen 1afef44f19 fix: self->shardsAffectedByTeamFailure->moveShard must be called without any waits after getting the destination team or we could miss failure notifications for the storage servers in the destination team 2021-11-23 15:26:38 -08:00
Evan Tschannen e3422b2443 fix: change feed streams were not being closed properly 2021-11-23 15:01:44 -08:00
Evan Tschannen 37c9a1320c added --print_sim_time to print simulated time to stdout 2021-11-23 15:01:44 -08:00
Evan Tschannen b0aad44831 change feed requests with an explicit end need to get empty versions at the end boundary 2021-11-23 15:01:44 -08:00
Evan Tschannen 3360000a91 fix: an empty mutation vector did not mean that all of the data was returned 2021-11-23 15:01:44 -08:00
Evan Tschannen 9df287ea06 fixed empty version merge logic 2021-11-23 15:01:44 -08:00
Evan Tschannen 6d9f134bf0 fix: merge needs to update on empty versions to release other mutations blocked by the empty version 2021-11-23 15:01:44 -08:00
Evan Tschannen 014fb2f31c fix: onEmpty must check all merged streams 2021-11-23 15:01:44 -08:00
Evan Tschannen a0afe530f8 protect against the changeFeedStorageData getting destroyed 2021-11-23 15:01:44 -08:00
Evan Tschannen d9a6feea72 fix: properly initialize notAtLeast 2021-11-23 15:01:44 -08:00
Evan Tschannen e97d337ffe fix: when a feed transitions from atLatest to not atLatest stall all updates at the blocked version 2021-11-23 15:01:44 -08:00
Evan Tschannen 10a925b7e9 do not return mutations larger than the dequeVersion 2021-11-23 15:01:44 -08:00
Evan Tschannen e19277160e improved the change feed workload to test whenAtLeast 2021-11-23 15:01:44 -08:00
Evan Tschannen 547c5899f8 whenAtLeast could return an incorrect result when the connection closed 2021-11-23 15:01:44 -08:00
Evan Tschannen 31b2414706 fixed a crash while popping change feeds 2021-11-23 15:01:44 -08:00
Evan Tschannen f3bb1d8f51 properly handle an active change feed stream when removed 2021-11-23 15:01:44 -08:00
Evan Tschannen 11d5cae515 do not buggify peek cursor expire time too low because it could cause the log routers to fail to make progress 2021-11-23 15:00:34 -08:00
Andrew Noyes 6c35084c2e
Merge pull request #6040 from sfc-gh-anoyes/anoyes/fix-loading-older-clients
Don't require fdb_transaction_get_range_and_flat_map in older clients
2021-11-22 13:07:24 -08:00
sfc-gh-ngoyal 12e68da635
Merge pull request #6036 from sfc-gh-satherton/redwood-debug-sim-fixes
Test-only bug fixes in Redwood along with debug logging detail improvements.
2021-11-22 11:13:28 -08:00
Andrew Noyes c6472790e3 Don't require fdb_transaction_get_range_and_flat_map in older clients 2021-11-22 10:49:26 -08:00
sfc-gh-ngoyal e43ddb09ac
Merge pull request #6034 from sfc-gh-satherton/remap-window-fix
Bug fix:  incorrect remap cleanup window size in KeyValueStoreRedwood
2021-11-22 09:12:59 -08:00
sfc-gh-ngoyal 9e76baa854
Merge pull request #6037 from Doxense/add-missing-windows-bind-header
Add missing bind header for Windows (master)
2021-11-22 09:10:00 -08:00
Mohamed Oulmahdi fe98f1ea56 Add missing bind header for Windows (boost/bind/bind.hpp) 2021-11-22 15:50:32 +01:00
Steve Atherton d2149631d5 Bug fix, the remap cleanup window was being initialized incorrectly in the Redwood KVS wrapper. 2021-11-19 21:40:09 -08:00
Russell Sears d332d03b34 Have individual YCSB containers record completion of their phase of the load. This allows loads to succeed even if the fdb-kubernetes-tests client crashes out mid run 2021-11-19 14:33:23 -08:00
A.J. Beamon 3f409bff7a
Merge pull request #6028 from rajivr/binding-tester-docs
docs: Clarify that `"ERROR"` is a byte string
2021-11-19 08:37:58 -08:00
Steve Atherton 3901d60548 Test-only bug fixes in Redwood along with debug logging detail improvements. Added clearRemapQueue() to Pager to more cleanly and reliably expire all old data and process the remap queue, fixing a bug where with certain configuration parameters and a lot of data the DestructiveSanityCheck would fail because it would not run cleanup long enough. Added more parameters to performance/set unit test. 2021-11-19 01:00:14 -08:00
Trevor Clinkenbeard 3d0ed2083c
Merge pull request #6000 from sfc-gh-tclinkenbeard/setup-flow-knobs
Setup global flow knobs in `setupNetwork`
2021-11-18 19:30:26 -08:00
Trevor Clinkenbeard 8bbde5185c
Merge pull request #5884 from sfc-gh-tclinkenbeard/add-format-warning
Enable clang -Wformat warning
2021-11-18 19:30:11 -08:00
Rajiv Ranganath ad56935216 docs: Clarify that `"ERROR"` is a byte string
`string` can be ambiguous as `Tuple` layer supports both `byte string`
and unicode `string`.

Signed-off-by: Rajiv Ranganath <rajiv.ranganath@atihita.com>
2021-11-19 06:11:04 +05:30
Renxuan Wang 22e34bd6b9 Replace <boost/bind.hpp> with <boost/bind/bind.hpp>.
This eliminates many useless warnings when compiling.
`#pragma message: The practice of declaring the Bind placeholders (_1, _2, ...) in the global namespace is deprecated. Please use <boost/bind/bind.hpp> + using namespace boost::placeholders, or define BOOST_BIND_GLOBAL_PLACEHOLDERS to retain the current behavior.`
2021-11-18 14:00:13 -08:00
Andrew Noyes 39b33bce90
Merge pull request #6020 from apple/anoyes/multiversion-package
Don't adduser in client postinstall
2021-11-18 12:15:48 -08:00
sfc-gh-tclinkenbeard 0532fbfb8b Merge remote-tracking branch 'origin/master' into setup-flow-knobs 2021-11-18 12:09:15 -08:00
sfc-gh-tclinkenbeard c745002607 Merge remote-tracking branch 'origin/master' into add-format-warning 2021-11-18 11:13:03 -08:00
Andrew Noyes 71fa5e86b9 Don't adduser in client postinstall 2021-11-18 10:52:37 -08:00
Lukas Joswiak 18243351e7 Fix possible data race
Transactions (created on a separate thread) can read the `globals` field
at the same time as `setGlobal` is called on the main thread, causing a
potential race. TSAN surfaced this issue.
2021-11-18 10:16:20 -08:00
Evan Tschannen 5879d611f5
Merge pull request #5899 from sfc-gh-jfu/jfu-fix-ss-segfault
Fix rare segfault that can occur when SS terminates while an actor that uses the StorageServer is still on the stack
2021-11-18 09:57:11 -08:00
sfc-gh-tclinkenbeard 2613ec7561 Expand use of fmt to get rid of %ld usage 2021-11-17 17:03:32 -08:00
Aaron Molitor 124e7eb4f2 refactor docker directory
- make release images ALL based from centos:7
- keep eks images that are based from amazonlinux:2, but create strong alignment with release (centos7) images
- use multi-stage Dockerfile(s)
- have a single build-images script
- remove per image directories (which would only contain scripts that are copied into images)
- remove empty requirements.txt file for sidecar.py (the pip command, package and version are in the Dockerfile)
- don't copy docker into PROJECT_BINARY_DIR
- incorporate latest changes already in master
2021-11-17 16:29:07 -08:00
Tao Lin 9a07a117d2
Not warn on constant-logical-operand when compile with clang (#5990) 2021-11-17 16:23:20 -08:00
sfc-gh-tclinkenbeard 07349869d9 Use fmt to address -Wformat warnings 2021-11-17 14:45:48 -08:00
sfc-gh-tclinkenbeard 766a05d33c Merge remote-tracking branch 'origin/master' into add-format-warning 2021-11-17 12:14:01 -08:00
John Brownlee 01c37a053a
Merge pull request #5993 from brownleej/new-image-fixes
Updates to fdb-kubernetes-monitor to ease integration with the Kubernetes operator
2021-11-17 11:56:19 -08:00
Steve Atherton 874c418459
Merge pull request #5217 from sfc-gh-ngoyal/bit-flipping-workload
Chaos workloads
2021-11-17 10:45:36 -08:00
Steve Atherton 6db71241eb Merge branch 'bit-flipping-workload' of github.com:sfc-gh-ngoyal/foundationdb into bit-flipping-workload 2021-11-17 10:00:16 -08:00
Steve Atherton 8a6df5c31c Remove unsupported .clang-format setting. 2021-11-17 09:59:38 -08:00
negoyal 8b0938c7b3 Added a TODO 2021-11-17 09:45:50 -08:00
Steve Atherton 3caca74ac2 Merge commit 'fd707c6d7ee80de6d9fda5796da2d0add10abd79' into bit-flipping-workload 2021-11-16 21:54:27 -08:00
Steve Atherton 80031e4ae6 Make DiskFailureCycle test do less work so valgrind tests finish faster. 2021-11-16 21:15:42 -08:00