llvm-project/lldb/packages/Python/lldbsuite/test/issue_verification
Todd Fiala 8cc2bddb32 test infra: clear file-charged issues on rerun of file
This change addresses the corner case bug in the test
infrastructure where a test file times out *outside*
of any running test method.  In those cases, the issue
was charged to the file, not to a test method within
the file.  When that file is re-run successfully,
none of the test-method-level successes would clear
the file-level issue.

This change fixes that: for all test files that are
getting rerun (whether by being marked flaky or
via the --rerun-all-issues flag), file-level test
issues are searched for in each of those files.  Each
file-level issue found in the rerun file list then
gets cleared.

A test of this feature is added to issue_verification,
using the technique there of moving the *.py.park file
to *.py to do an end-to-end validation.

This change also adds a .gitignore entry for pyenv
project-level files and fixes up a few minor pep8
formatting violations in files I touched.

Fixes:
llvm.org/pr27423

llvm-svn: 282990
2016-10-01 00:17:08 +00:00
..
Makefile test infra: fix lldbinline tests to work with rerun 2015-12-22 17:14:47 +00:00
README.txt
TestExpectedTimeout.py.park [test] Add ability to expect timeouts 2015-12-16 12:09:45 +00:00
TestFail.py.park
TestInvalidDecorator.py.park test infra: catch bad decorators and import-time errors 2016-05-13 21:36:26 +00:00
TestRerunFail.py.park test infra: enable single-worker rerun phase for flakey tests. 2015-12-14 21:28:46 +00:00
TestRerunFileLevelTimeout.py.park test infra: clear file-charged issues on rerun of file 2016-10-01 00:17:08 +00:00
TestRerunInline.py.park test infra: fix lldbinline tests to work with rerun 2015-12-22 17:14:47 +00:00
TestRerunTimeout.py.park fix a race is the LLDB test suite results collection 2016-04-18 16:09:21 +00:00
TestSignal.py.park
TestSignalOutsideTestMethod.py.park test infra: adds book-keeping for rerunnable tests 2015-12-12 19:26:56 +00:00
TestTimeout.py.park
disable.py enable timeout/exceptional exit support for xUnit formatter 2015-12-09 22:02:31 +00:00
enable.py enable timeout/exceptional exit support for xUnit formatter 2015-12-09 22:02:31 +00:00
inline_rerun_inferior.cpp test infra: fix lldbinline tests to work with rerun 2015-12-22 17:14:47 +00:00
rerun_base.py test infra: enable single-worker rerun phase for flakey tests. 2015-12-14 21:28:46 +00:00

README.txt

Tests in this directory are intentionally setup to
fail, error, timeout, etc. to verify that the buildbots
pick up errors.  The tests in this directory will be
parked/removed/renamed after verifying they trigger
as expected.