maxjhandsome
/
llvm-project
forked from OSchip/llvm-project
1
0
Fork 0
Code Issues Pull Requests Packages Releases Wiki Activity
llvm-project/llvm/utils/lit/tests/Inputs
History
Brian Homerding d5c558ff21 [lit] - Allow 1 test to report multiple micro-test results to provide support for microbenchmarks. 
Summary:
These changes are to allow to a Result object to have nested Result objects in
order to support microbenchmarks. Currently lit is restricted to reporting one
result object for one test, this change provides support tests that want to
report individual timings for individual kernels.

This revision is the result of the discussions in
https://reviews.llvm.org/D32272#794759,
https://reviews.llvm.org/D37421#f8003b27 and https://reviews.llvm.org/D38496.
It is a separation of the changes purposed in https://reviews.llvm.org/D40077.

This change will enable adding LCALS (Livermore Compiler Analysis Loop Suite)
collection of loop kernels to the llvm test suite using the google benchmark
library (https://reviews.llvm.org/D43319) with tracking of individual kernel
timings.

Previously microbenchmarks had been handled by using macros to section groups
of microbenchmarks together and build many executables while still getting a
grouped timing (MultiSource/TSVC). Recently the google benchmark library was
added to the test suite and utilized with a litsupport plugin. However the
limitation of 1 test 1 result limited its use to passing a runtime option to
run only 1 microbenchmark with several hand written tests
(MicroBenchmarks/XRay). This runs the same executable many times with different
hand-written tests. I will update the litsupport plugin to utilize the new
functionality (https://reviews.llvm.org/D43316).

These changes allow lit to report micro test results if desired in order to get
many precise timing results from 1 run of 1 test executable.


Reviewers: MatzeB, hfinkel, rengolin, delcypher

Differential Revision: https://reviews.llvm.org/D43314

llvm-svn: 327422
 		2018-03-13 16:37:59 +00:00
..
config-map-discovery [lit] Actually do normalize the case of files in the config map. 2017-09-21 21:27:11 +00:00
discovery
…
exec-discovery
…
exec-discovery-in-tree
…
googletest-format [lit] Port googletest lit tests to Windows 2017-07-28 01:05:55 +00:00
googletest-timeout [lit] Port googletest lit tests to Windows 2017-07-28 01:05:55 +00:00
googletest-upstream-format [lit] Port googletest lit tests to Windows 2017-07-28 01:05:55 +00:00
max-failures [lit] Use a %{python} substitution to avoid relying on python being on PATH 2017-07-28 21:13:47 +00:00
progress-bar
…
py-config-discovery [lit] Make lit support config files with .py extension. 2017-09-21 00:24:52 +00:00
shtest-env [lit] support unsetting env variables (again!) 2017-08-18 17:32:57 +00:00
shtest-format lit::shtest-format.py: Make write-bad-encoding.py py3-aware. 2017-07-29 02:52:56 +00:00
shtest-output-printing
…
shtest-shell [lit] Implement "-r" option for builtin "diff" command + a test using that. 2018-01-09 18:23:34 +00:00
shtest-timeout [lit] Remove unused imports (NFC) 2016-10-03 04:48:18 +00:00
test-data [lit] Implement timeouts and max_time for process pool testing 2017-04-06 00:38:28 +00:00
test-data-micro [lit] - Allow 1 test to report multiple micro-test results to provide support for microbenchmarks. 2018-03-13 16:37:59 +00:00
testrunner-custom-parsers [lit] Support custom parsers in parseIntegratedTestScript 2016-12-05 20:21:21 +00:00
unittest-adaptor
…