maxjhandsome
/
llvm-project
forked from OSchip/llvm-project
1
0
Fork 0
Code Issues Pull Requests Packages Releases Wiki Activity
llvm-project/compiler-rt/test/fuzzer/print_unstable_stats.test

25 lines
734 B
Plaintext
Raw Normal View History

[libFuzzer] Disable print_unstable_stats.test for aarch64. Summary: Follow-up for https://reviews.llvm.org/D50264. Reported by testbots: http://lab.llvm.org:8011/builders/clang-cmake-aarch64-full/builds/5592 Reviewers: morehouse, kevinwkt, metzman, javed.absar, Dor1s Reviewed By: Dor1s Subscribers: kristof.beyls, delcypher, #sanitizers, llvm-commits, kcc Differential Revision: https://reviews.llvm.org/D50386 llvm-svn: 339143
2018-08-07 22:22:00 +08:00
# Tests -print_unstable_stats
[libFuzzer] Enable tests on Windows Summary: Enable tests on Windows and make check-fuzzer pass on it. Make check-fuzzer pass on Windows by fixing libFuzzer, fixing tests, and by disabling tests on Windows. Most of these are disabled temporarily as support for the tests and the features they test will be added incrementally. Other tests will not be enabled since they require things that are not on Windows (eg: afl_driver tests). Every test that was explicitly disabled on Windows has a comment explaining why (unless obvious like merge-posix.test). The lit.cfg file was modified to support running tests on windows. fuzzer-dirs.test was fixed by making the Windows implementation print the same error message as the posix version. merge-control-file.test was fixed by making the test binary end with the ".exe" extension (on all platforms). Patch By: metzman Reviewers: morehouse Reviewed By: morehouse Subscribers: srhines, mgorny Differential Revision: https://reviews.llvm.org/D51549 llvm-svn: 341385
2018-09-05 01:08:47 +08:00
# Disabled on Windows because of differences symbolizing and flakiness.
UNSUPPORTED: aarch64, windows
[libFuzzer] Disable print_unstable_stats.test for aarch64. Summary: Follow-up for https://reviews.llvm.org/D50264. Reported by testbots: http://lab.llvm.org:8011/builders/clang-cmake-aarch64-full/builds/5592 Reviewers: morehouse, kevinwkt, metzman, javed.absar, Dor1s Reviewed By: Dor1s Subscribers: kristof.beyls, delcypher, #sanitizers, llvm-commits, kcc Differential Revision: https://reviews.llvm.org/D50386 llvm-svn: 339143
2018-08-07 22:22:00 +08:00
[libFuzzer] Implement stat::stability_rate based on the percentage of unstable edges. Summary: Created a -print_unstable_stats flag. When -print_unstable_stats=1, we run it 2 more times on interesting inputs poisoning unstable edges in an array. On program termination, we run PrintUnstableStats() which will print a line with a stability percentage like AFL does. Patch by Kyungtak Woo (@kevinwkt). Reviewers: metzman, Dor1s, kcc, morehouse Reviewed By: metzman, Dor1s, morehouse Subscribers: delcypher, llvm-commits, #sanitizers, kcc, morehouse, Dor1s Differential Revision: https://reviews.llvm.org/D49212 llvm-svn: 337187
2018-07-17 00:01:31 +08:00
RUN: %cpp_compiler %S/PrintUnstableStatsTest.cpp -o %t-PrintUnstableStatsTest
[libFuzzer] Add unstable function printing to print_unstable_stats flag Summary: There may be cases in which a user wants to know which part of their code is unstable. We use ObservedFuncs and UnstableCounters to print at exit which of the ObservedFunctions are unstable under the -print_unstable_stats flag. Patch by Kyungtak Woo (@kevinwkt). Reviewers: Dor1s, metzman, morehouse Reviewed By: Dor1s, metzman, morehouse Subscribers: delcypher, #sanitizers, llvm-commits, kcc Differential Revision: https://reviews.llvm.org/D50264 llvm-svn: 339081
2018-08-07 07:14:13 +08:00
[libFuzzer] Implement stat::stability_rate based on the percentage of unstable edges. Summary: Created a -print_unstable_stats flag. When -print_unstable_stats=1, we run it 2 more times on interesting inputs poisoning unstable edges in an array. On program termination, we run PrintUnstableStats() which will print a line with a stability percentage like AFL does. Patch by Kyungtak Woo (@kevinwkt). Reviewers: metzman, Dor1s, kcc, morehouse Reviewed By: metzman, Dor1s, morehouse Subscribers: delcypher, llvm-commits, #sanitizers, kcc, morehouse, Dor1s Differential Revision: https://reviews.llvm.org/D49212 llvm-svn: 337187
2018-07-17 00:01:31 +08:00
RUN: %run %t-PrintUnstableStatsTest -print_unstable_stats=1 -runs=100000 2>&1 | FileCheck %s --check-prefix=LONG
[libFuzzer] Enable tests on Windows Summary: Enable tests on Windows and make check-fuzzer pass on it. Make check-fuzzer pass on Windows by fixing libFuzzer, fixing tests, and by disabling tests on Windows. Most of these are disabled temporarily as support for the tests and the features they test will be added incrementally. Other tests will not be enabled since they require things that are not on Windows (eg: afl_driver tests). Every test that was explicitly disabled on Windows has a comment explaining why (unless obvious like merge-posix.test). The lit.cfg file was modified to support running tests on windows. fuzzer-dirs.test was fixed by making the Windows implementation print the same error message as the posix version. merge-control-file.test was fixed by making the test binary end with the ".exe" extension (on all platforms). Patch By: metzman Reviewers: morehouse Reviewed By: morehouse Subscribers: srhines, mgorny Differential Revision: https://reviews.llvm.org/D51549 llvm-svn: 341385
2018-09-05 01:08:47 +08:00
# We do not observe ini functions since we take the minimum hit counts, and minimum hit counts for ini is 0.
[libFuzzer] Add unstable function printing to print_unstable_stats flag Summary: There may be cases in which a user wants to know which part of their code is unstable. We use ObservedFuncs and UnstableCounters to print at exit which of the ObservedFunctions are unstable under the -print_unstable_stats flag. Patch by Kyungtak Woo (@kevinwkt). Reviewers: Dor1s, metzman, morehouse Reviewed By: Dor1s, metzman, morehouse Subscribers: delcypher, #sanitizers, llvm-commits, kcc Differential Revision: https://reviews.llvm.org/D50264 llvm-svn: 339081
2018-08-07 07:14:13 +08:00
LONG: UNSTABLE_FUNCTIONS:
LONG-NOT: det0()
LONG-NOT: det1()
LONG-NOT: det2()
LONG-NOT: det3()
LONG-NOT: det4()
LONG-NOT: ini0()
LONG-NOT: ini1()
LONG-NOT: ini2()
LONG-DAG: t0(int)
LONG-DAG: t1()
LONG-DAG: t2(int, int)
LONG-DAG: t3()
LONG-DAG: t4(int, int, int)
LONG-DAG: stat::stability_rate: 27.59