llvm-project/llgo/utils/benchcomp
Peter Collingbourne eb2d1a782c benchcomp: Add a mode for analyzing file sizes.
llvm-svn: 299376
2017-04-03 19:13:12 +00:00
..
README
analyze.R
main.go benchcomp: Add a mode for analyzing file sizes. 2017-04-03 19:13:12 +00:00

README

These are some quick and dirty tools for measuring the performance impact
of a change to llgo by sampling the results of running the libgo benchmark
suite. They can be used to calculate the geo-mean and 95% confidence interval
using the Student's t-test. The benchcomp program massages the output of the
Go benchmark tools into a form that can be read by the R program analyze.R
which runs the statistics.

To use, clpatch this into gofrontend:
https://codereview.appspot.com/103550047/

then run:

make
make -C workdir/gofrontend_build/libgo-stage1 bench 2>&1 | tee before.out
# make changes
make
make -C workdir/gofrontend_build/libgo-stage1 bench 2>&1 | tee after.out
utils/benchcomp/benchcomp benchns before.out after.out | R -f utils/benchcomp/analyze.R

The results should be displayed on stdout.