maxjhandsome
/
llvm-project
forked from OSchip/llvm-project
1
0
Fork 0
Code Issues Pull Requests Packages Releases Wiki Activity
llvm-project/llvm/lib/Fuzzer/test/fuzzer.test

60 lines
3.1 KiB
Plaintext
Raw Normal View History

[lib/Fuzzer] add dfsan_weak_hook_memcmp, enable the test that uses it, simplify the test runner llvm-svn: 236683
2015-05-07 08:11:33 +08:00
CHECK: BINGO
[Fuzzer] Rely on $PATH expansion instead of hardcoding paths in tests. NFC. llvm-svn: 242851
2015-07-22 06:51:55 +08:00
RUN: LLVMFuzzer-SimpleTest 2>&1 | FileCheck %s
[libFuzzer] When -test_single_input crashes the test it is not necessary to write crash-file because input is already known to the user. Patch by Mike Aizatsky llvm-svn: 250564
2015-10-17 06:41:47 +08:00
RUN: not LLVMFuzzer-NullDerefTest -test_single_input=%S/hi.txt 2>&1 | FileCheck %s --check-prefix=SingleInput
SingleInput-NOT: Test unit written to ./crash-
Reverting r227452, which adds back the fuzzer library. Now excluding the fuzzer library based on LLVM_USE_SANITIZE_COVERAGE being set or unset. llvm-svn: 227464
2015-01-30 00:58:29 +08:00
[Fuzzer] Rely on $PATH expansion instead of hardcoding paths in tests. NFC. llvm-svn: 242851
2015-07-22 06:51:55 +08:00
RUN: not LLVMFuzzer-InfiniteTest -timeout=2 2>&1 | FileCheck %s --check-prefix=InfiniteTest
Reverting r227452, which adds back the fuzzer library. Now excluding the fuzzer library based on LLVM_USE_SANITIZE_COVERAGE being set or unset. llvm-svn: 227464
2015-01-30 00:58:29 +08:00
InfiniteTest: ALARM: working on the last Unit for
[libFuzzer] add -artifact_prefix flag llvm-svn: 249807
2015-10-09 11:57:59 +08:00
InfiniteTest: Test unit written to ./timeout-
Reverting r227452, which adds back the fuzzer library. Now excluding the fuzzer library based on LLVM_USE_SANITIZE_COVERAGE being set or unset. llvm-svn: 227464
2015-01-30 00:58:29 +08:00
[libFuzzer] add a flag -max_total_time llvm-svn: 249181
2015-10-03 04:47:55 +08:00
RUN: LLVMFuzzer-SimpleCmpTest -max_total_time=1 2>&1 | FileCheck %s --check-prefix=MaxTotalTime
MaxTotalTime: Done {{.*}} runs in {{.}} second(s)
[Fuzzer] Rely on $PATH expansion instead of hardcoding paths in tests. NFC. llvm-svn: 242851
2015-07-22 06:51:55 +08:00
RUN: not LLVMFuzzer-TimeoutTest -timeout=5 2>&1 | FileCheck %s --check-prefix=TimeoutTest
Reverting r227452, which adds back the fuzzer library. Now excluding the fuzzer library based on LLVM_USE_SANITIZE_COVERAGE being set or unset. llvm-svn: 227464
2015-01-30 00:58:29 +08:00
TimeoutTest: ALARM: working on the last Unit for
[libFuzzer] add -artifact_prefix flag llvm-svn: 249807
2015-10-09 11:57:59 +08:00
TimeoutTest: Test unit written to ./timeout-
[libFuzzer] print a stack trace on timeout llvm-svn: 250571
2015-10-17 07:04:31 +08:00
TimeoutTest: == ERROR: libFuzzer: timeout after
TimeoutTest: #0
TimeoutTest: #1
TimeoutTest: #2
TimeoutTest: SUMMARY: libFuzzer: timeout
Reverting r227452, which adds back the fuzzer library. Now excluding the fuzzer library based on LLVM_USE_SANITIZE_COVERAGE being set or unset. llvm-svn: 227464
2015-01-30 00:58:29 +08:00
[libFuzzer] When -test_single_input crashes the test it is not necessary to write crash-file because input is already known to the user. Patch by Mike Aizatsky llvm-svn: 250564
2015-10-17 06:41:47 +08:00
RUN: not LLVMFuzzer-TimeoutTest -timeout=5 -test_single_input=%S/hi.txt 2>&1 | FileCheck %s --check-prefix=SingleInputTimeoutTest
SingleInputTimeoutTest: ALARM: working on the last Unit for
SingleInputTimeoutTest-NOT: Test unit written to ./timeout-
[Fuzzer] Rely on $PATH expansion instead of hardcoding paths in tests. NFC. llvm-svn: 242851
2015-07-22 06:51:55 +08:00
RUN: not LLVMFuzzer-NullDerefTest 2>&1 | FileCheck %s --check-prefix=NullDerefTest
[libFuzzer] add -artifact_prefix flag llvm-svn: 249807
2015-10-09 11:57:59 +08:00
NullDerefTest: Test unit written to ./crash-
RUN: not LLVMFuzzer-NullDerefTest -artifact_prefix=ZZZ 2>&1 | FileCheck %s --check-prefix=NullDerefTestPrefix
NullDerefTestPrefix: Test unit written to ZZZcrash-
[fuzzer] add -use_full_coverage_set=1 which solves FullCoverageSetTest. This does not scale very well yet, but might be a good start. llvm-svn: 227507
2015-01-30 07:01:07 +08:00
[libFuzzer] remove experimental flag and functionality llvm-svn: 249194
2015-10-03 06:00:32 +08:00
#not LLVMFuzzer-FullCoverageSetTest -timeout=15 -seed=1 -mutate_depth=2 -use_full_coverage_set=1 2>&1 | FileCheck %s
[lib/Fuzzer] add dfsan_weak_hook_memcmp, enable the test that uses it, simplify the test runner llvm-svn: 236683
2015-05-07 08:11:33 +08:00
[libFuzzer] remove experimental flag and functionality llvm-svn: 249194
2015-10-03 06:00:32 +08:00
#not LLVMFuzzer-FourIndependentBranchesTest -timeout=15 -seed=1 -use_traces=1 2>&1 | FileCheck %s
[lib/Fuzzer] add dfsan_weak_hook_memcmp, enable the test that uses it, simplify the test runner llvm-svn: 236683
2015-05-07 08:11:33 +08:00
[Fuzzer] Rely on $PATH expansion instead of hardcoding paths in tests. NFC. llvm-svn: 242851
2015-07-22 06:51:55 +08:00
RUN: not LLVMFuzzer-CounterTest -use_counters=1 -max_len=6 -seed=1 -timeout=15 2>&1 | FileCheck %s
[fuzzer] one more experimental search mode: -use_coverage_pairs=1 llvm-svn: 229957
2015-02-20 11:02:37 +08:00
[Fuzzer] Rely on $PATH expansion instead of hardcoding paths in tests. NFC. llvm-svn: 242851
2015-07-22 06:51:55 +08:00
RUN: not LLVMFuzzer-SimpleCmpTest -use_traces=1 -seed=1 -runs=1000000 -timeout=5 2>&1 | FileCheck %s
DFSan-based fuzzer (proof of concept). Summary: This adds a simple DFSan-based (i.e. taint-guided) fuzzer mutator, see the comments for details. Test Plan: a test added Reviewers: samsonov, pcc Reviewed By: samsonov, pcc Subscribers: llvm-commits Differential Revision: http://reviews.llvm.org/D8669 llvm-svn: 233613
2015-03-31 06:09:51 +08:00
[Fuzzer] Rely on $PATH expansion instead of hardcoding paths in tests. NFC. llvm-svn: 242851
2015-07-22 06:51:55 +08:00
RUN: not LLVMFuzzer-UserSuppliedFuzzerTest -seed=1 -timeout=15 2>&1 | FileCheck %s
[lib/Fuzzer] extend the fuzzer interface to allow user-supplied mutators llvm-svn: 238059
2015-05-23 06:35:31 +08:00
[libFuzzer] add two flags, -tbm_depth and -tbm_width to control how the trace-based-mutations are applied llvm-svn: 244712
2015-08-12 09:55:37 +08:00
RUN: not LLVMFuzzer-MemcmpTest -use_traces=1 -seed=1 -runs=100000 2>&1 | FileCheck %s
[libFuzzer] implement memcmp hook for data-flow-guided fuzzing (w/o dfsan), extend the memcmp fuzzer test llvm-svn: 243603
2015-07-30 09:34:58 +08:00
RUN: LLVMFuzzer-MemcmpTest -seed=1 -runs=1000000 2>&1 | FileCheck %s --check-prefix=Done1000000
Done1000000: Done 1000000 runs in
[libFuzzer] implement strncmp hook for data-flow-guided fuzzing (w/ and w/o dfsan), add a test llvm-svn: 243611
2015-07-30 10:33:45 +08:00
[libFuzzer] add two flags, -tbm_depth and -tbm_width to control how the trace-based-mutations are applied llvm-svn: 244712
2015-08-12 09:55:37 +08:00
RUN: not LLVMFuzzer-StrncmpTest -use_traces=1 -seed=1 -runs=100000 2>&1 | FileCheck %s
[libFuzzer] implement strncmp hook for data-flow-guided fuzzing (w/ and w/o dfsan), add a test llvm-svn: 243611
2015-07-30 10:33:45 +08:00
RUN: LLVMFuzzer-StrncmpTest -seed=1 -runs=1000000 2>&1 | FileCheck %s --check-prefix=Done1000000
[libFuzzer] trace switch statements and apply mutations based on the expected case values llvm-svn: 243726
2015-07-31 09:33:06 +08:00
[libFuzzer] add two flags, -tbm_depth and -tbm_width to control how the trace-based-mutations are applied llvm-svn: 244712
2015-08-12 09:55:37 +08:00
RUN: not LLVMFuzzer-StrcmpTest -use_traces=1 -seed=1 -runs=100000 2>&1 | FileCheck %s
[libFuzzer] use data-flow feedback from strcmp llvm-svn: 244084
2015-08-06 02:23:01 +08:00
RUN: LLVMFuzzer-StrcmpTest -seed=1 -runs=1000000 2>&1 | FileCheck %s --check-prefix=Done1000000
[libFuzzer] make sure that 2-byte arguments of switch() are handled properly llvm-svn: 243781
2015-08-01 04:58:55 +08:00
RUN: not LLVMFuzzer-SwitchTest -use_traces=1 -seed=1 -runs=1000000 2>&1 | FileCheck %s
[libFuzzer] trace switch statements and apply mutations based on the expected case values llvm-svn: 243726
2015-07-31 09:33:06 +08:00
RUN: LLVMFuzzer-SwitchTest -seed=1 -runs=1000000 2>&1 | FileCheck %s --check-prefix=Done1000000
[libFuzzer] actually make the dictionaries work (+docs) llvm-svn: 246825
2015-09-04 08:12:11 +08:00
RUN: not LLVMFuzzer-SimpleDictionaryTest -dict=%S/dict1.txt -seed=1 -runs=1000000 2>&1 | FileCheck %s
RUN: LLVMFuzzer-SimpleDictionaryTest -seed=1 -runs=1000000 2>&1 | FileCheck %s --check-prefix=Done1000000
[libFuzzer]Add a test for defeating a hash sum. Summary: Add a test for a data followed by 4-byte hash value. I use a slightly modified Jenkins hash function, as described in https://en.wikipedia.org/wiki/Jenkins_hash_function The modification is to ensure that hash(zeros) != 0. Reviewers: kcc Subscribers: llvm-commits Differential Revision: http://reviews.llvm.org/D12648 llvm-svn: 247076
2015-09-09 05:22:52 +08:00
RUN: not LLVMFuzzer-SimpleHashTest -use_traces=1 -seed=1 -runs=100000 2>&1 | FileCheck %s
RUN: LLVMFuzzer-SimpleHashTest -seed=1 -runs=1000000 2>&1 | FileCheck %s --check-prefix=Done1000000