a4bcd3919d
Add exclusive process class for Blob Worker.
...
Also introduces a specific machine in the simulated cluster
to test blob worker (similar to what's done for storage cache).
2021-09-23 16:54:44 -04:00
1730d75f73
change configure test
...
add store type check
add test file
2021-09-21 18:11:04 -07:00
16171d8252
Refactoring well-known endpoint registration
...
- List all well-known endpoints of FDB in a single enum
- Identify well-known endpoints by plain IDs
2021-09-21 11:05:31 -06:00
df84223f5c
fix compiler error
2021-09-20 13:58:05 -07:00
8926951a0a
restore the original tssMode in restarting tests
2021-09-20 13:58:05 -07:00
abf73047ca
Enforce std:: specifier rather than using namespace
2021-09-16 19:40:28 -07:00
5728c97fd0
fixing tss enablement with fault injections
2021-09-15 09:26:19 -06:00
9992a7b33f
Added StorageMigrationType and cli commands
2021-09-14 09:55:41 -05:00
0fd4cc14d7
Disable rocksdb in simulation to unblock CI.
2021-09-13 16:17:44 -07:00
627ef2e739
Enable rocksdb storage in simulation with some simulation fixes.
2021-09-10 11:11:29 -07:00
c2d1d1704f
Merge branch 'feature-range-feed' into blob_full
2021-09-10 11:21:52 -05:00
b9e4bb7217
Fix reading the disableTss option
2021-09-03 12:47:02 -07:00
8d49c98a41
Added simulation workload for blob granules and fixed some bugs
2021-08-26 13:48:05 -05:00
8bde0b3136
Disable RocksDB storage engine in simulation
2021-08-23 14:56:13 -04:00
bd5a87e0e3
Fix TestConfig::ConfigBuilder::trace_visitor::operator()(Optional<std::vector<int>> const* val)
2021-08-09 10:04:35 -07:00
f6b6e11d6a
Support randomizing configuration database type in simulation
2021-08-09 10:04:35 -07:00
82546853c0
Rename UseConfigDB to ConfigDBType
2021-08-09 10:04:35 -07:00
cdbcb69d86
Add configuration database type to ISimulator
2021-08-09 10:04:35 -07:00
7deb339a0c
Added ConfigIncrement.toml test
2021-08-09 10:04:35 -07:00
e9c3da1f0f
Disable rocksdb selection for VALGRIND builds.
2021-08-02 13:47:37 -07:00
507c1f11e3
Add .log() to bare TraceEvent() invocations without any .detail()s to avoid clang-tidy warning about immediate destruction of object without use.
2021-07-26 19:55:10 -07:00
d36b5d62df
Fault Injection Active/Deactivation - Edit TSS mode set_config
2021-07-26 10:41:17 -07:00
e04646e267
Fault Injection Active/Deactivation
2021-07-23 16:28:20 -07:00
66883e5f1c
Disable the RocksDB engine in simulation in restarting tests or when it isn't built
2021-07-16 12:51:38 -04:00
0f99d449fc
Revert "Merge pull request #5194 from apple/revert-5144-rocksdb-in-simulation"
...
This reverts commit 8ecff8c730c8e18f99f0
2021-07-16 12:01:01 -04:00
b7b845dab8
Revert "RocksDB in simulation"
2021-07-15 16:41:33 -07:00
ac46992120
Add warn trace event about non-determinism
2021-07-13 12:25:11 -04:00
0613ff892f
Enable RocksDB in simulation
2021-07-13 12:25:11 -04:00
3d0536dcec
Improve safety of backup agent poll delay
2021-07-05 13:22:31 -07:00
fcb8bd6475
Revert "Make the sim2 run loop match the behavior of the net2 run loop."
2021-06-22 14:50:01 -07:00
154332a94b
Merge branch 'master' of https://github.com/apple/foundationdb into feature-sim-time-batching
...
# Conflicts:
# fdbserver/VersionedBTree.actor.cpp
2021-06-22 09:37:40 -07:00
c47644f055
Merge pull request #5012 from sfc-gh-jfu/jfu-configure-sim-cluster
...
Modularize generateNormalConfig code to improve readability
2021-06-21 15:02:57 -06:00
c0a9ad6c9e
fix signatures and missing references
2021-06-18 14:54:33 -04:00
666305dabe
remove broken include
2021-06-18 14:43:21 -04:00
f23d2bd603
factor out chunks of generateNormalConfig for readability and modularization
2021-06-18 14:35:51 -04:00
826e70916c
Merge remote-tracking branch 'origin/master' into config-db
2021-06-17 09:47:41 -07:00
83c703d10b
Merge branch 'master' of github.com:apple/foundationdb into jfu-configure-sim-cluster
2021-06-16 16:58:43 -04:00
90be55537c
initial commit
2021-06-16 16:58:32 -04:00
05aea49d16
Merge pull request #4986 from sfc-gh-mpilman/bugfixes/double-ss
...
Bugfixes/double ss
2021-06-16 14:43:32 -06:00
9a24a57007
refactor templates to make them more readable and reusable
2021-06-16 10:46:21 -06:00
56eaf1bc83
added comments
2021-06-15 16:49:27 -06:00
c6f47c1f15
Fixed segfault with simple mode
2021-06-15 16:00:19 -06:00
41c790b299
Merge remote-tracking branch 'origin/master' into config-db
2021-06-10 22:31:23 -07:00
13ee24f464
Add UseConfigDB class
2021-06-10 20:57:50 -07:00
59726545a4
TSS downgrade changes
2021-06-10 19:30:45 +00:00
08a5f17660
Merge branch 'master' of https://github.com/apple/foundationdb into feature-sim-time-batching
...
# Conflicts:
# fdbserver/DataDistribution.actor.cpp
2021-06-08 10:04:06 -07:00
743691f3cd
Disable configuration database in simulation by default
2021-06-06 09:00:00 -07:00
838d847d4e
Merge pull request #4860 from sfc-gh-xwang/ppwtest
...
implement perpetual storage wiggling feature
2021-06-04 16:18:39 -07:00
aca3941519
found bug in detecting first test in restart
2021-06-02 20:40:00 +00:00
a775f92fca
Merge remote-tracking branch 'origin/master' into config-db
2021-06-01 15:39:34 -07:00
8b9c8b33fc
manually merge with master
2021-06-01 17:51:42 +00:00
d67184163b
Merge pull request #4556 from sfc-gh-jslocum/tss
...
Testing Storage Server
2021-06-01 09:11:10 -07:00
d35da1aeae
Merge pull request #4873 from sfc-gh-ajbeamon/close-files-in-simulation
...
Actually close files in simulation
2021-05-28 15:32:10 -07:00
60d27d05d8
add knob enabling cross cluster support (default true)
2021-05-27 08:08:07 -04:00
065c4fdd5a
issue 4252
2021-05-27 08:08:07 -04:00
a756469670
Use a weak reference in the open files cache (abstracted from a similar cache in AsyncFileCached) to avoid a problem where removing an item from the cache could cause us to reentrantly remove it again.
2021-05-26 13:38:24 -07:00
d68cb9b048
Changing role names and enabling tss by default in consistency check
2021-05-25 22:21:43 +00:00
51b402fa04
simulation setting
2021-05-25 21:29:25 +00:00
4257ac2b4d
More TSS Changes/Fixes
2021-05-25 20:37:48 +00:00
ce82c9653e
Testing Storage Server implementation
2021-05-25 20:28:50 +00:00
f11b7ffa5f
merge master, fix promise callback bug
2021-05-25 18:43:08 +00:00
64608fe86b
allow simulation properties to be overwritten
2021-05-20 13:48:41 -06:00
f57f0d64f4
Merge branch 'master' into feature-sim-time-batching
...
# Conflicts:
# fdbserver/DataDistribution.actor.cpp
2021-05-20 09:09:35 -07:00
fcc6efd3b1
Add .cluster.configuration status json field
2021-05-18 10:47:16 -07:00
0dd11cb2f6
Added --ignore_config_db and --use_test_config_db command line arguments
2021-05-17 19:14:32 -07:00
4b848867f9
Break down configuration database unit tests and fix some more bugs
2021-05-16 23:16:08 -07:00
9c844916d8
Create new ConfigKnobOverrides and ManualKnobOverrides classes
2021-05-12 10:12:37 -07:00
7681f38f45
Add config_classes command line option for fdbserver
2021-05-11 18:23:33 -07:00
a02da36e85
fixed the problem with the GrvProxyClass the proper way my keeping the enum the same between versions
2021-04-26 18:45:44 -07:00
5279512097
the enum values changed so the master class in the previous version is the same as GrvProxyClass now
2021-04-26 18:06:25 -07:00
f1559a2203
use the stateless process class instead of master or resolution in simulation because it is the recommended process class, and the others are not deterministic when recruited in a constrained process situation
2021-04-26 09:49:26 -07:00
2a64c227fb
Added options to test config that specify maxtlogversion and array of excluded storage engine types
2021-04-07 15:59:51 -04:00
ce8fce94c8
Merge pull request #4596 from sfc-gh-etschannen/fix-starting-config
...
Fixed simulations which timeout setting starting configuration
2021-03-31 10:31:28 -06:00
e774262046
fix: g_simulator.disableRemote did not contain the rest of the configuration
2021-03-30 21:11:26 -07:00
9fd3c559c2
Added some missing comments for structs
2021-03-23 17:24:00 -04:00
1254a21caa
Initialize extraDB in simulationConfig according to TestConfig parameter
2021-03-23 14:58:00 -04:00
44d4b1c540
Use const ref to avoid copying of TestConfig struct
2021-03-22 16:10:26 -04:00
c4a374a014
Added comments to checkTestConf
2021-03-22 15:28:26 -04:00
db80674877
Added comments to modified functions
2021-03-22 15:24:46 -04:00
711a21094b
Factor out test config parameters into a single structure
2021-03-22 14:30:22 -04:00
488fe6f008
give more time to cleanup tasks when rebooting
2021-03-17 21:50:19 -07:00
2cd3f45fd6
Merge remote-tracking branch 'apple/release-6.3' into master-format-final
...
release-6.3 was recently merged, and there were two PRs which were
merged in between and got those changes in here. Hence, since all the
changes were in, discarded the incoming changes and accepted all
current.
2021-03-10 16:50:44 -08:00
df90cc89de
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-10 10:18:07 -08:00
8a8c488ede
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-05 18:13:38 -06:00
79cec09255
Apply clang-tidy's performance-inefficient-vector-operation fix
...
I ran this command in my build directory after compiling with
OPEN_FOR_IDE. It took a few small tweaks to get it to compile, which is
outside the scope of this commit.
$ python run-clang-tidy.py -j $(nproc) -checks='-*,performance-inefficient-vector-operation' -fix
2021-03-04 03:58:25 +00:00
346a4e3ecd
Merge branch 'release-6.3'
...
# Conflicts:
# fdbcli/fdbcli.actor.cpp
# fdbrpc/LoadBalance.actor.h
# fdbrpc/MultiInterface.h
# fdbserver/ClusterController.actor.cpp
# fdbserver/MasterProxyServer.actor.cpp
# fdbserver/masterserver.actor.cpp
2021-03-01 18:52:06 -08:00
bb32198267
Reboot simulated process on io_timeout error
2021-02-17 00:47:32 -08:00
5e80e16802
Revert "CDs reject requests from external cluster or requests need to be forwarded based on an old forward request."
2021-02-05 13:05:33 -08:00
9f837a3b84
Coordinators will not serve following requests after this change:
...
- A request that needs to be forwarded after the forward was set for a long(configured via Knobs) time.
- A request that has a different connection string than the CD's local connection string.
Simulation has been made to work with this change.
2021-01-29 13:24:45 -08:00
5bfa6cea98
Merge remote-tracking branch 'origin/master' into misc-changes
2020-12-26 20:47:00 -04:00
f3c0d26806
Make ISimulator::BackupAgentType an enum class
2020-12-08 09:09:30 -08:00
c77d9e4abe
merge conflicts
2020-12-02 21:53:19 +00:00
bdd3dbfa7d
remove duplicates
2020-11-10 14:01:07 -07:00
4669f837fa
Add uses of makeReference
2020-11-07 22:10:18 -08:00
bda72d9a3d
first draft at changing snapshot backup behaviour
2020-11-02 17:12:30 -05:00
a94beaa5b2
fix add to make protocol version incompatible
2020-10-26 22:59:18 +00:00
309e38dc06
add unit test and some cleanup
2020-10-23 19:34:18 +00:00
d82dccd2ad
revert systemkey clear in recovery tx and backupagent on restart, moved to workload specifically
2020-10-20 17:26:16 -04:00
340e21fa93
fix unfixed conflicts again
2020-10-19 17:03:44 +00:00
f2a8687c7c
fix merge conflicts
2020-10-19 17:00:41 +00:00
Suraj Gupta