e97fb31d9b
Added some comment
2021-07-14 17:46:15 +03:00
04549c59ed
Fixed 'NoTraceFileGenerated' error in simulation tests when fdbserver process could not start
2021-07-14 17:41:08 +03:00
c5a9ff02a9
move file out of build directory
2021-07-12 13:06:29 -07:00
efdda3cd0e
Revert "Revert "Add support for running non-simulation tests on Joshua""
2021-06-15 14:15:02 -04:00
549cf0512b
Revert "Add support for running non-simulation tests on Joshua"
2021-06-14 19:23:56 -04:00
3a70012c08
Merge pull request #4971 from Daniel-B-Smith/test-nonsim
...
Add support for running non-simulation tests on Joshua
2021-06-14 13:56:24 -07:00
8af0affeff
Add support for running non-simulation tests on Joshua
2021-06-14 15:00:45 -04:00
948f4993b9
Convert to 32 bit int
2021-06-09 17:07:45 -07:00
04694a6f70
Respect JOSHUA_SEED if set
...
Closes #4913
2021-06-09 16:21:50 -07:00
d067ca507b
Surfacing non-fatal parse errors in Test Harness output
2021-05-19 20:04:12 +00:00
ccb092a2c8
Fix file name
2021-05-10 09:01:24 -07:00
d07f527a98
Fix raw_input
2021-05-08 16:32:03 -07:00
98665f9bae
Convert apiversioner.py to Python 3
2021-05-08 16:31:53 -07:00
fe7419262d
Add tool for upgrading API versions
2021-05-08 16:31:43 -07:00
64d01e9303
Merge pull request #3997 from ajbeamon/grv-proxy-model
...
A model used to quickly simulate various GRV scenarios and algorithms
2021-05-03 13:52:49 -07:00
b93b41cbf6
Some cleanup of fdb_c_version:
...
* Support Python 3 and make it the default
* Use str(e) instead of e.message to print errors
* Don't convert library_path to an absolute path so that we can load the system fdb_c.
2021-04-12 13:20:04 -07:00
82db2ddce5
Add tool to detect client version
2021-04-12 09:49:44 -07:00
b8b2be7918
Disable lsan in joshua
2021-03-16 00:44:23 +00:00
df90cc89de
apply clang-format to *.c, *.cpp, *.h, *.hpp files
2021-03-10 10:18:07 -08:00
540c6bb709
Ignore expected ASAN message
2021-02-18 19:18:07 +00:00
a8d08a8792
Merge branch 'release-6.3' into merge-release-6.3-into-master
2021-02-09 10:18:00 -08:00
0650ff1a41
Increase the maximum length of the error strings logged by test harness. Make it more obvious when errors are being truncated.
2021-02-05 15:54:51 -08:00
58b4a9b907
Resolve conflicts
2021-01-21 20:59:44 +00:00
281151ff20
Merge remote-tracking branch 'upstream/release-6.2' into anoyes/merge-6.2-to-6.3
...
Commit conflict markers for now
2021-01-21 17:54:26 +00:00
ddb5b0b050
Backport correctness package
2021-01-15 00:34:47 +00:00
76838a20b7
A model used to quickly simulate various GRV scenarios and algorithms
2020-10-30 09:11:08 -07:00
0faaecc780
Merge branch 'master' into merge
2020-10-29 22:27:40 -07:00
cf4c8e375f
Merge remote-tracking branch 'origin/release-6.3' into merge
2020-10-29 22:15:41 -07:00
362bd757c6
Make FDB >=4.x ignore old binaries before FDB 4.x
...
The motivation for this is so that Snowflake can add use TestHarness to run
FDB3 in Joshua, and be able to load FDB3 binaries into the image for restarting
tests.
2020-10-29 02:23:51 -07:00
89a1559910
Handle versions being >1 digits.
2020-10-29 02:23:39 -07:00
f2de49332c
TestHarness should check --version before choosing an old binary.
...
This allows joshua to run on binaries older than the most recent version,
because restarting/upgrade tests won't start with a newer version than what is
under test.
2020-10-29 02:23:34 -07:00
16108c0795
Handle versions being >1 digits.
2020-10-27 13:12:42 -07:00
ee45ed1c11
TestHarness should check --version before choosing an old binary.
...
This allows joshua to run on binaries older than the most recent version,
because restarting/upgrade tests won't start with a newer version than what is
under test.
2020-10-26 19:19:45 -07:00
c622a11c70
Merge branch 'master' of https://github.com/apple/foundationdb into jfu-snapshot-record-version
2020-10-05 13:15:56 -04:00
268ba0bddc
Merge remote-tracking branch 'origin/release-6.3' into merge-6.3
2020-10-01 14:14:06 -06:00
ee8ed6781b
change test harness to check .toml restarting tests
2020-09-30 14:23:25 -04:00
40b51cbdbb
Added support to specify the FDB Cluster Text
...
Added support fo specify the number of ports from which to choose
Swapped tabs for spaces to make Marcus happy 😃
2020-09-23 17:58:47 -04:00
5d60663bbf
Make bindingtester scripts more k8s friendly
2020-09-23 16:14:19 -04:00
ac63273ae3
Make bindingtester scripts more k8s friendly
2020-09-22 22:35:00 -07:00
cf69f455a9
Merge pull request #3785 from apple/release-6.3
...
Merge Release 6.3 to master
2020-09-17 14:43:56 -07:00
b060f53bab
Added support for randomizing the port from 4000 to 4999
2020-09-12 00:39:36 -04:00
2d0b9fb12b
Declared local status variables
...
Added checks to ensure that cluster died when killed via cli
Changed error message
2020-09-11 17:44:09 -04:00
35bef73a1c
Rename proxy to commit proxy
2020-09-10 17:44:15 -07:00
5e06f41c59
Corrected spelling
...
Removed unused lines from file
2020-09-09 13:42:59 -04:00
06527ffb70
Capture any errors along with standard output
2020-09-01 15:12:58 -04:00
335bf882cd
Disabled audit by default
2020-09-01 15:12:31 -04:00
9ee4e38ca4
Fixed location of the knob
2020-09-01 13:59:00 -04:00
a88a41d07e
Disabled kernel AIO for bindingtester to allow ramdisk to be supported
...
Added sleep to kill command to allow time for server to receive the command
2020-09-01 13:38:52 -04:00
d40bdff7e8
Called the kill command before killing cluster
2020-09-01 11:12:57 -04:00
6dddac5af2
Fixed the kill call to the coordinator
2020-09-01 10:25:03 -04:00
d349efba57
Added support for killing the cluster gracefully
2020-09-01 10:08:52 -04:00
8fa599a435
Removed total seconds from audit
2020-09-01 09:53:03 -04:00
e5a8bf659a
Ensure that the cluster is stopped when exiting
2020-09-01 09:34:46 -04:00
738248dff2
Added support for a global audit log to help debugging efforts
2020-09-01 09:33:37 -04:00
79424f6d7a
Optionally kill existing servers
...
Moved wait amounts to variables
Made server address to a random ip address on local host
2020-08-31 19:38:37 -04:00
2f76dd0b76
Remove unnecessary special case handling from JsonParser
2020-08-18 10:46:06 -07:00
2f52c5f79b
Merge branch 'release-6.3'
...
# Conflicts:
# fdbserver/RestoreLoader.actor.cpp
2020-08-11 22:45:43 -07:00
9a0a9acdd1
Merge pull request #3586 from sfc-gh-kmakino/kaomakino/fdbcstat
...
fdbcstat: FDB C API monitoring utility
2020-08-07 14:38:08 -07:00
66a41089dc
Increment TestHarness version
...
Co-authored-by: Markus Pilman <markus.pilman@snowflake.com>
2020-08-07 14:28:27 -04:00
c82a81b124
Fixed whitespace
2020-08-07 13:50:49 -04:00
6ec05e1fd8
Removed unneeded include for TestHarness
2020-08-07 13:50:01 -04:00
12b51f7889
Added separate function to display version information for TestHarness
2020-08-07 12:44:21 -04:00
bc0ef5d0d7
Fixed the name of the TestHarness cmake file
2020-08-07 12:40:52 -04:00
d5b39f649c
Updated cmake to work with TestHarness source file
2020-08-07 12:37:27 -04:00
c07aaf2d72
Removed Application config
...
Made TestHarness source file a cmake file
2020-08-07 12:03:35 -04:00
0f6a01aef4
Added TestHarness application config
2020-08-07 10:57:14 -04:00
005b59cc84
Added support for storing and displaying version within TestHarness
2020-08-07 10:46:38 -04:00
97b8c43b86
Merge pull request #3497 from sfc-gh-kmakino/kaomakino/testharness_json_support
...
Add JSON trace support in TestHarness (Take 2)
2020-08-03 14:27:01 -07:00
8335aac191
fdbcstat: FDB C API monitoring utility
2020-07-31 18:34:51 -07:00
a49cb41de7
Merge branch 'release-6.3'
...
# Conflicts:
# CMakeLists.txt
# cmake/ConfigureCompiler.cmake
# fdbserver/Knobs.cpp
# fdbserver/StorageCache.actor.cpp
# fdbserver/storageserver.actor.cpp
# flow/ThreadHelper.actor.h
# flow/serialize.h
# tests/CMakeLists.txt
2020-07-29 00:31:55 -07:00
369d1be562
Fixed test harness bug
2020-07-12 16:06:23 -07:00
c942ee995e
Deserialize report_conflicting_keys in 6.3
2020-07-11 23:13:51 -07:00
13eaf7b88b
Add JSON trace support in TestHarness
2020-07-11 01:13:39 +00:00
f29dd53f66
Revert "Add JSON trace support in TestHarness"
...
This reverts commit 5e96fd9a96
2020-07-10 11:26:27 -06:00
949a17359a
Added to_6.3.0 downgrade test to test harness
2020-07-09 14:29:43 -07:00
3b09308915
Merge pull request #3350 from sfc-gh-kmakino/kaomakino/add_json_trace_support_in_test_harness
...
Add JSON trace support in TestHarness
2020-07-09 08:27:43 -07:00
8c5d14422d
Fix crash when no transactions are found by the transaction profiling analyzer
2020-07-02 16:56:04 -07:00
5e96fd9a96
Add JSON trace support in TestHarness
2020-06-12 18:44:05 -07:00
d128252e90
Merge release-6.3 into master
2020-05-22 09:25:32 -07:00
2c611dc00d
Parse dc_id in transaction profiler tool.
2020-05-21 22:59:42 -07:00
74691f83b3
fix: transaction_profiling_analyzer wasn't passing protocol_version everywhere that it was used.
2020-05-19 17:22:20 -07:00
1786469e3c
Merge pull request #2881 from ajbeamon/transaction-profiling-analyzer-perf-improvements
...
Performance improvements to the transaction profiling analyzer
2020-05-19 10:49:46 -07:00
0da199b201
Move wait_for_shard_addresses into ShardFinder. Remove unneeded transactional decorator.
2020-05-19 08:28:16 -07:00
d6bc5263ad
Add read version and commit version info to getVersion and commit client transaction events.
2020-05-03 22:42:06 -07:00
902c08715e
Fix sorting bug that can occur when ordering point and range reads
2020-04-16 11:52:58 -07:00
e493ced88f
removed unused variable
2020-04-13 20:06:33 -07:00
4b5fdef976
fix correctness dependencies
2020-04-10 18:16:52 -07:00
5a64dab74f
fix linker error
2020-04-09 14:27:13 -07:00
d4542dbb5a
Delete old build system
2020-04-07 11:03:45 -07:00
60484af8e0
More performance improvements to loading ranges. Fix range accounting to avoid double counting ranges. Add some new features related to filtering by address, listing top read requests, querying for all reads.
2020-04-02 13:50:27 -07:00
cbcd0abdc0
Fixed the creation of binding test package
2020-03-31 18:40:25 -07:00
a45533b326
Performance improvements to range insertion
2020-03-30 14:43:59 -07:00
10795cdc1a
Some performance improvements to the transaction profiling analyzer:
...
* Fetch the boundary keys once and cache the results
* Try to get addresses for shards in the same transaction and in parallel
* Simplify the range count logic (this seems not to be a clear win performance-wise, I've seen this go twice as fast or take 50% longer)
Also added a flag to enable ports on addresses.
2020-03-30 13:17:29 -07:00
94e653b6d8
Update contrib/Joshua/scripts/bindingTestScript.sh
...
Co-Authored-By: Alvin Moore <36203359+AlvinMooreSr@users.noreply.github.com>
2020-03-27 09:36:21 -07:00
022a90dc3a
Merge branch 'correctness_pkg' into features/build-test-harness
2020-03-26 13:13:38 -07:00
d80014cbc3
Added Joshua Readme and scripts for describing and implementing correctness for FoundationDB
2020-03-26 02:33:45 -07:00
ce6c4cb8d8
Build and package TestHarness
2020-03-25 17:36:47 -07:00
e7e559cbae
Merge pull request #2706 from etschannen/feature-test-harness
...
Added TestHarness and TraceLogHelper for assisting with automated simulation testing
2020-03-20 10:29:22 -07:00
a38a7fc8b4
updated copyright date
2020-03-20 10:15:33 -07:00
5ad9807c21
Small fixes
2020-03-17 17:21:52 -04:00
f0be82752a
commit_debug can visualize CommitDebug TraceEvents via chrome://tracing
2020-02-28 21:25:45 -08:00
d7ab4db2b8
added TestHarness and TraceLogHelper for assisting with automated simulation testing
2020-02-20 11:50:12 -08:00
b58f185a14
Add transaction_profiling_analyzer tests
2020-01-30 12:02:18 -08:00
3bf971ba8b
Merge branch 'release-6.2' of github.com:apple/foundationdb into release_6.2_merge
...
# Conflicts:
# documentation/sphinx/source/release-notes.rst
# fdbserver/storageserver.actor.cpp
2019-12-12 07:13:12 -08:00
f77a64dce1
Mov alloc_instrumentation.py to contrib/
2019-11-05 13:04:00 -08:00
cecef8d0b5
Added contrib folder to foundationdb. New tool called transaction_profiling_analyzer has been added to the folder. It is a python script that parses transaction profiling info and analyzes hot keys and ranges. Also monitoring folder has been moved to the contrib folder.
2019-11-04 16:31:20 -08:00
Oleg Samarin