dc828d8407
Port #7123 ( #8315 )
...
Only run valgrind on the binary under test
2022-09-26 09:14:15 -07:00
11a4f8a672
Fix the computation of the maximum array bound for the decoding array
2022-09-21 14:29:36 -07:00
22e24582f1
The base64 decoder was making invalid assumptions about the signedness of the char type.
2022-09-21 14:29:36 -07:00
852280a4d1
Add an option to disable kernel-aio in test harness
...
I'm using this for experimenting with criu: https://criu.org/Main_Page ,
which doesn't support kernel aio.
2022-09-14 11:06:01 -07:00
cfec8bdd61
Use tls plugin for old binaries < 5.2.0
...
This fixes restart tests from old binaries < 5.2.0, which previously
were immediately crashing in a TLS codepath. This behavior was not
originally ported from the old test harness to the new test harness.
2022-09-12 13:46:37 -07:00
a04ba073c1
Merge pull request #8062 from sfc-gh-anoyes/anoyes/test-harness-stderr
...
Fix a type error when stderr is too large in test harness
2022-09-01 08:36:37 -05:00
6d1df591e2
Fix a type error when stderr is too large in test harness
...
Also increase the threshold. 10000 seems more appropriate for asan since
it prints a symbolized stack trace to stderr.
2022-08-31 12:04:23 -07:00
4bdf94141e
Set the default testharness config from environment ( #8050 )
2022-08-31 09:07:59 -05:00
922d8abe43
Allow expected messages in stderr in new test harness ( #8046 )
...
The old test harness allowed certain messages to appear in the stderr
text. Port that behavior to the new test harness so that the ASAN
ensemble works again.
2022-08-30 15:03:34 -07:00
98039f6ca1
Merge remote-tracking branch 'origin/main' into features/new-test-harness
2022-08-26 13:52:25 -06:00
2592ca7b2c
remove wrong subdir include
2022-08-25 16:16:21 -06:00
1ef7859c9a
deleted empty cmake file, commented in empty py-file
2022-08-25 16:05:15 -06:00
e2534e96f5
Address review comments
2022-08-25 11:42:55 -06:00
5107bc337e
Apply suggestions from code review
...
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2022-08-25 08:56:18 -06:00
80cbb25680
fixed stupid logical bug
2022-08-24 15:21:31 -06:00
fcca5cec6d
remove todo -- this change is generally useful
2022-08-24 11:56:28 -06:00
a61d9d1cd2
Merge remote-tracking branch 'origin' into env
2022-08-24 13:06:47 -04:00
ffaf17c24e
some bug fixes and some debugging code
2022-08-24 09:11:36 -06:00
70fced0c87
don't do unseed check for noSim tests
2022-08-23 22:43:41 -06:00
cca714ef0c
fix typo and delete simfdb dir for unseed checks
2022-08-23 21:02:04 -06:00
edad0f35d2
valgrind reports include stack traces
2022-08-23 18:06:11 -06:00
50be189a0f
Merge remote-tracking branch 'origin' into env
2022-08-23 17:01:48 -04:00
43420a43ef
port timeout scripts and use new test harness for valgrind
2022-08-23 14:38:58 -06:00
253e6cf914
Merge pull request #7944 from sfc-gh-ajbeamon/valgrind-backtrace
...
Include an addr2line backtrace with valgrind errors in test harness
2022-08-23 13:13:27 -07:00
3545708b91
addressed review comments
2022-08-22 21:06:11 -06:00
2d9f8ba3ea
fixed xml formatting
2022-08-22 20:44:24 -06:00
41ac372931
test_harness.result generates valid json
2022-08-22 20:38:42 -06:00
798ae8913c
fixed detailed output and move success to own flag
2022-08-22 10:34:24 -06:00
180024b76d
implemented testClass and testPriority
2022-08-22 09:57:44 -06:00
8d4d09c470
fix attribute copying
2022-08-21 11:41:05 -06:00
951f426832
Fix unseed check
2022-08-21 11:38:28 -06:00
2d1917e053
Merge remote-tracking branch 'origin/main' into features/new-test-harness
2022-08-21 11:14:19 -06:00
6fc91096a8
generate reproduction command in result
2022-08-21 11:13:39 -06:00
cd7af3f7c8
Also print test errors in results
...
We now attempt to import joshua.joshua_model. If this succeeds
test_harness.results will also print test errors
2022-08-21 10:42:24 -06:00
7c53e8ee81
Added RunningUnitTest to output
2022-08-21 08:23:51 -06:00
4808307354
collect and report on code probe information
2022-08-20 20:01:09 -06:00
90863d07ad
test harness now uses runtime to choose next test
2022-08-20 15:56:12 -06:00
6afc36cc33
add splunk dashboards ( #7942 )
2022-08-19 20:05:37 -04:00
d56a9bba61
Report all of the stacks for a valgrind error, not just the primary one
2022-08-19 15:38:03 -07:00
3a3a38a36d
Include an addr2line backtrace with valgrind errors in test harness
2022-08-19 14:12:15 -07:00
2bf6a838b8
basic functionality working
2022-08-17 16:27:44 -06:00
2704891c1a
handle include and exclude, fix reporting
2022-08-16 13:21:58 -06:00
0971ee5f7a
enable new test harness for correctness builds
2022-08-16 11:31:37 -06:00
03382c6267
Fix ErrorCommitInfo event parser
2022-08-15 13:22:17 -07:00
072c10ed44
Merge pull request #7823 from sfc-gh-anoyes/anoyes/improve-determinism
...
Improve determinism (based on JOSHUA_SEED)
2022-08-15 14:09:49 -06:00
dab1c5984d
fixed most mypy errors
2022-08-15 13:56:44 -06:00
c5f623af31
Add new test harness
2022-08-15 11:09:08 -06:00
35a3a33d1c
Resolve TSAN-related issues in ctests ( #7864 )
2022-08-12 19:23:32 +02:00
8a02b666d0
Make test_fdb_pkgs faster and fix test_execstack_permissions_libfdb_c ( #7832 )
2022-08-09 21:58:38 +02:00
2002ebf6ef
Track resident memory usage in test harness
...
We switched to limiting based on resident memory usage, so track that
instead.
2022-08-08 10:05:39 -07:00
Andrew Noyes