a04ba073c1
Merge pull request #8062 from sfc-gh-anoyes/anoyes/test-harness-stderr
...
Fix a type error when stderr is too large in test harness
2022-09-01 08:36:37 -05:00
6d1df591e2
Fix a type error when stderr is too large in test harness
...
Also increase the threshold. 10000 seems more appropriate for asan since
it prints a symbolized stack trace to stderr.
2022-08-31 12:04:23 -07:00
4bdf94141e
Set the default testharness config from environment ( #8050 )
2022-08-31 09:07:59 -05:00
922d8abe43
Allow expected messages in stderr in new test harness ( #8046 )
...
The old test harness allowed certain messages to appear in the stderr
text. Port that behavior to the new test harness so that the ASAN
ensemble works again.
2022-08-30 15:03:34 -07:00
1ef7859c9a
deleted empty cmake file, commented in empty py-file
2022-08-25 16:05:15 -06:00
e2534e96f5
Address review comments
2022-08-25 11:42:55 -06:00
5107bc337e
Apply suggestions from code review
...
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2022-08-25 08:56:18 -06:00
80cbb25680
fixed stupid logical bug
2022-08-24 15:21:31 -06:00
fcca5cec6d
remove todo -- this change is generally useful
2022-08-24 11:56:28 -06:00
ffaf17c24e
some bug fixes and some debugging code
2022-08-24 09:11:36 -06:00
70fced0c87
don't do unseed check for noSim tests
2022-08-23 22:43:41 -06:00
cca714ef0c
fix typo and delete simfdb dir for unseed checks
2022-08-23 21:02:04 -06:00
edad0f35d2
valgrind reports include stack traces
2022-08-23 18:06:11 -06:00
43420a43ef
port timeout scripts and use new test harness for valgrind
2022-08-23 14:38:58 -06:00
3545708b91
addressed review comments
2022-08-22 21:06:11 -06:00
2d9f8ba3ea
fixed xml formatting
2022-08-22 20:44:24 -06:00
41ac372931
test_harness.result generates valid json
2022-08-22 20:38:42 -06:00
798ae8913c
fixed detailed output and move success to own flag
2022-08-22 10:34:24 -06:00
180024b76d
implemented testClass and testPriority
2022-08-22 09:57:44 -06:00
8d4d09c470
fix attribute copying
2022-08-21 11:41:05 -06:00
951f426832
Fix unseed check
2022-08-21 11:38:28 -06:00
6fc91096a8
generate reproduction command in result
2022-08-21 11:13:39 -06:00
cd7af3f7c8
Also print test errors in results
...
We now attempt to import joshua.joshua_model. If this succeeds
test_harness.results will also print test errors
2022-08-21 10:42:24 -06:00
7c53e8ee81
Added RunningUnitTest to output
2022-08-21 08:23:51 -06:00
4808307354
collect and report on code probe information
2022-08-20 20:01:09 -06:00
90863d07ad
test harness now uses runtime to choose next test
2022-08-20 15:56:12 -06:00
2bf6a838b8
basic functionality working
2022-08-17 16:27:44 -06:00
2704891c1a
handle include and exclude, fix reporting
2022-08-16 13:21:58 -06:00
0971ee5f7a
enable new test harness for correctness builds
2022-08-16 11:31:37 -06:00
dab1c5984d
fixed most mypy errors
2022-08-15 13:56:44 -06:00
c5f623af31
Add new test harness
2022-08-15 11:09:08 -06:00
Markus Pilman