3a0678e33c
[analyzer] Apply whitespace cleanups by Honggyu Kim.
...
llvm-svn: 246978
2015-09-08 03:50:52 +00:00
da32a86341
[Static Analyzer] Made it easier to test new checkers using the test suite.
...
llvm-svn: 245637
2015-08-20 22:59:49 +00:00
c3177f2ed4
[Static Analyzer] Make the paths relative from the project root when generating reference results in the test suite.
...
llvm-svn: 241706
2015-07-08 18:39:31 +00:00
2ed9456015
[Static Analyzer] No longer include the full path of the source file in the single file tests' bug identifiers.
...
llvm-svn: 241292
2015-07-02 19:20:46 +00:00
93fde94d81
[Static Analyzer] Minor improvements to SATest.
...
Differential Revision: http://reviews.llvm.org/D10812
llvm-svn: 241073
2015-06-30 15:31:17 +00:00
8a020310b8
[analyzer] Rename NewDeleteLeaks checker in the test script.
...
Fixup to r220289.
llvm-svn: 220976
2014-10-31 17:40:14 +00:00
d473363876
Correct hyphenations in comments and assert messages
...
This patch tries to avoid unrelated changes other than fixing a few
hyphen-related ambiguities in nearby lines.
llvm-svn: 196466
2013-12-05 04:47:09 +00:00
7bd9186cdd
[analyzer] SATestBuild: strip trailing newlines from command file.
...
When running a make-based command, SATestBuild tries to append a -jN flag
with an appropriate N to run the build in parallel. However, it failed
to take into account that each line read includes a trailing newline
(unless it is the last line of a file without a trailing newline), which
resulted in the "-jN" appearing on a line on its own.
llvm-svn: 190164
2013-09-06 16:12:41 +00:00
c7b992edcf
[analyzer] SATestBuild: Don't require reference results to have logs.
...
The Logs directory isn't used for testing, so it's filtered out ahead of
time. However, there's then no reason to include it in version control at
all. Don't error if it's not present.
llvm-svn: 183689
2013-06-10 19:34:30 +00:00
7b4f8a4181
[analyzer] Always use ccc-analyzer when running scan-build on buildbot
...
llvm-svn: 182982
2013-05-31 02:31:09 +00:00
10ad081fc6
[analyzer] Re-enable cplusplus.NewDelete (but not NewDeleteLeaks).
...
As mentioned in the previous commit message, the use-after-free and
double-free warnings for 'delete' are worth enabling even while the
leak warnings still have false positives.
llvm-svn: 178891
2013-04-05 17:55:07 +00:00
01acbcebbb
[analyzer] Moving cplusplus.NewDelete to alpha.* for now.
...
llvm-svn: 178529
2013-04-02 05:59:24 +00:00
13df03624b
[analyzer] Adds cplusplus.NewDelete checker that check for memory leaks, double free, and use-after-free problems of memory managed by new/delete.
...
llvm-svn: 177849
2013-03-25 01:35:45 +00:00
b042cc7822
[analyzer] CmpRuns.py: Accept single files as input.
...
This allows us to compare two direct invocations of the analyzer on a
single source file without having to wrap the output plists in their
own directories.
llvm-svn: 177804
2013-03-23 01:21:26 +00:00
b18179da33
scan-build: Add a --keep-empty option for better testing.
...
SATestBuild expects to compare output directories for each invocation of
scan-build that it runs, but scan-build clears out empty directories by
default. We were coincidentally not getting that behavior until r173294.
llvm-svn: 173383
2013-01-24 23:07:59 +00:00
64e4cf001b
[analyzer] SATestBuild.py: allow make builds to disable parallelization
...
Before, SATestBuild unilaterally added '-j<n>' to every project built with
'make'. Now, we check and see if there's a -j option already specified, which
allows a project to explicitly be marked '-j1'.
llvm-svn: 168603
2012-11-26 19:59:57 +00:00
8832924acb
[analyzer] SATestBuild.py: fix broken string concatenation
...
This has been broken for a while, but the branch was never being taken.
(We were trying to do 'str + floatVal'; now we do 'str % intVal' and use
the '%d' format.)
llvm-svn: 168174
2012-11-16 17:41:21 +00:00
fab9bb6890
[analyzer] CmpRuns: move the clang_version info into the run (out of
...
report)
llvm-svn: 168105
2012-11-15 22:42:44 +00:00
f477505d03
[analyzer] SATestBuild.py: correctly add -j option for projects using make.
...
llvm-svn: 168099
2012-11-15 22:03:53 +00:00
9821e57c09
[analyzer] Ensure that CmpRuns recursively walks the output directory.
...
llvm-svn: 167981
2012-11-14 21:32:16 +00:00
69e2bf9e0c
[analyzer] Test SimpleStream on the buildbot.
...
llvm-svn: 167317
2012-11-02 21:30:07 +00:00
639b40484e
[analyzer] CmpRuns: cleanup APIs, allow processing of plists with no
...
clang_version, fix the compare routine.
llvm-svn: 166129
2012-10-17 21:09:26 +00:00
93283d0933
[analyzer] Expose clang_version in CmpRuns
...
llvm-svn: 166048
2012-10-16 19:36:39 +00:00
c80313b888
[analyzer] CmpRuns - cleaned up the API, added relative path getter
...
llvm-svn: 165995
2012-10-15 22:48:21 +00:00
dc1f6bc454
Add handy script for updating plist FileCheck expected output for
...
analyzer tests.
llvm-svn: 163486
2012-09-10 06:19:34 +00:00
a2f970baa6
[analyzer] testing: add a build mode to allow C++11 testing.
...
llvm-svn: 163357
2012-09-06 23:30:27 +00:00
9858b12381
Revert "[analyzer] Disable diagnostic checking on the buildbot."
...
This reverts commit befc0f648c83f65e1f3567f2058c7c18b4bc3ad8 now that
plist-html diagnostics are working again.
llvm-svn: 162966
2012-08-31 00:36:30 +00:00
5e2f0b2151
[analyzer] Disable diagnostic checking on the buildbot.
...
Due to recent diagnostic changes, we may generate malformed diagnostics.
llvm-svn: 162940
2012-08-30 21:04:09 +00:00
07a821fb17
[analyzer] Fixup 162863.
...
Thanks Jordan.
llvm-svn: 162875
2012-08-29 23:23:39 +00:00
f329823dc0
[analyzer]Fix typo, unbreak static analyzer BuildBot (at least
...
partially).
(Addresses a regression from r162790.)
llvm-svn: 162864
2012-08-29 21:22:40 +00:00
f9a539d858
Automatically use more cores when the test build uses 'make'.
...
llvm-svn: 162790
2012-08-28 20:40:04 +00:00
42c14428d2
Consolidate helper methods and configuration logic. No functionality change.
...
llvm-svn: 162789
2012-08-28 20:40:02 +00:00
6cb2080e5e
Pass --use-analyzer to scan-build when running within the test harness.
...
llvm-svn: 162783
2012-08-28 20:20:52 +00:00
4220144acb
experimental.security.taint is now alpha.security.taint
...
llvm-svn: 162775
2012-08-28 18:45:22 +00:00
7d2babc046
[analyzer] More internal stats collection.
...
llvm-svn: 162687
2012-08-27 18:38:32 +00:00
e12365bc27
[analyzer] Ted fixed the plist-html issue, so the assert can go away.
...
llvm-svn: 162598
2012-08-24 21:07:49 +00:00
af3ae3cbbd
[analyzer] Unbreak the static analyzer buildbot.
...
We no longer associate the correct HTML file with plist diagnostic.
Fall out from r162028.
llvm-svn: 162071
2012-08-17 01:09:13 +00:00
45a992b5f0
[analyzer] CmpRuns should include file name in the issue identifier.
...
This prevents us from treating the issues from different files with the
same function names and same offsets as the same.
The issue identifier now includes the file name. Also added a way to
strip off the root directories form the source file names.
llvm-svn: 161150
2012-08-02 00:41:40 +00:00
c2a3223da9
SATestBuild should not ask for non-existent checkers.
...
- "cocoa" was moved to "osx.cocoa" a long time ago.
- "cplusplus" would be a valid package except we don't have any C++ checkers.
llvm-svn: 160821
2012-07-26 22:31:59 +00:00
5920a1bdd1
Un-break standalone invocations of CmpRuns.py.
...
Fallout from CmpRuns.py API changes in r160314.
llvm-svn: 160800
2012-07-26 20:03:51 +00:00
9b7d7140ef
[analyzer] Make CmpRuns external-user friendly.
...
CmpRuns can be used for static analyzer bug report comparison. However,
we want to make sure external users do not rely on the way bugs are
represented (plist files). Make sure that we have a user
friendly/documented API for CmpRuns script.
llvm-svn: 160314
2012-07-16 20:21:42 +00:00
40b87fc1f9
[analyzer] Add a statistic for maximum CFG size and a script to summarize analyzer stats from scan-build output.
...
llvm-svn: 159776
2012-07-05 20:44:02 +00:00
d60367b893
[analyzer] Use "issue hash" in CmpRuns; followup on r158180
...
(For the future: It would be more efficient to produce a hash key with
the embedded function info inside the compiler.)
llvm-svn: 158187
2012-06-08 01:50:49 +00:00
dc191a184f
[analyzer] SATestBuild should execute SVN updates even if Verbose is off.
...
Also, re-use glob results when looking for failure logs.
llvm-svn: 157817
2012-06-01 16:24:43 +00:00
01ac57244c
[analyzer] Fix SATestAdd to work with SATestBuild.
...
Also, eliminate global 'IsReferenceBuild' in SATestBuild. It doesn't get
passed around that much.
llvm-svn: 157816
2012-06-01 16:24:38 +00:00
f5958eb2b4
Fix typo.
...
llvm-svn: 157229
2012-05-22 00:54:40 +00:00
c53ed2e158
Use Perl prototypes instead of shift.
...
llvm-svn: 157228
2012-05-22 00:52:49 +00:00
2fe1ed3e0d
Add basic delta-debugging script used for reducing analyzer crasher test cases.
...
llvm-svn: 157219
2012-05-21 23:29:01 +00:00
6ecb6a6b7f
[analyzer] Testing: These checkers are not experimental anymore.
...
llvm-svn: 150989
2012-02-20 21:10:40 +00:00
a432feaf26
[analyzer] Add the Malloc checker to the list of tested checkers.
...
llvm-svn: 150535
2012-02-15 00:19:07 +00:00
4c1ef976a8
[analyzer] Testing: add automated reference results reset.
...
llvm-svn: 149682
2012-02-03 06:35:23 +00:00
97981bdeb0
[analyzer] Testing: add 2 new checkers to the buildbot script.
...
llvm-svn: 149514
2012-02-01 16:46:57 +00:00
b3d896d333
[analyzer] Add the HTML file to the SATest diagnostic diff.
...
(Uses the functionality which has been in CmpRuns long before.)
llvm-svn: 148868
2012-01-24 21:57:35 +00:00
895c312404
[analyzer] Testing: make diagnostic diffs more informative (add
...
diagnostic message).
llvm-svn: 148867
2012-01-24 21:57:32 +00:00
a08c6b7efc
[analyzer] Unbreak the static analyzer bot. Regression from r148558.
...
When we build a single source file, we call clang directly (not though scan-build).
llvm-svn: 148612
2012-01-21 01:11:35 +00:00
7a75cf32a2
[analyzer] Tweak the buildbot script to include the experimental taint checker and correct the checker enabling setting.
...
llvm-svn: 148558
2012-01-20 19:10:59 +00:00
de1f7f8bfb
[analyzer] Testing infrastructure: Flush output after every print
...
statement.
llvm-svn: 147862
2012-01-10 18:10:25 +00:00
5acd9603da
[analyzer] Correct the error message in the testing infrastructure.
...
llvm-svn: 147568
2012-01-04 23:53:50 +00:00
26573c5585
[analyzer] Testing: test with all the non-experimental checker packages.
...
llvm-svn: 144142
2011-11-08 22:41:25 +00:00
a1b56e2aa3
[analyzer] Testing: support for regenerate reference output
...
Change the flow of the SATestAdd so that it could be used for regenerating
the reference output without exiting with an error.
llvm-svn: 144141
2011-11-08 22:41:22 +00:00
767d356f87
[analyzer] Testing: Display the number of reported differences in the main log.
...
llvm-svn: 144113
2011-11-08 19:56:31 +00:00
ae9d54bcf3
[analyzer] Testing infrastructure: flush the output between projects.
...
llvm-svn: 144051
2011-11-08 00:27:56 +00:00
84726dd72c
[analyzer] Relax the cmp criteria for analyzer reports.
...
Until we find out a way to easily find out what changed by looking at the logs.
llvm-svn: 143789
2011-11-05 05:20:56 +00:00
4720a730f6
[analyzer] Add support for testing with individual preprocessed files.
...
llvm-svn: 143786
2011-11-05 05:20:48 +00:00
42a4463091
[analyzer] Tweak the test script
...
Rename the pre_run_static_analyzer script into cleanup_run_static_analyzer
and use it to clean up after the reference build - which is done as part of
adding a new project to the system.
llvm-svn: 143568
2011-11-02 20:46:50 +00:00
f0c4116202
[analyzer] Static Analyzer Qualification Infrastructure: Scripts to support basic testing of the analyzer on external projects. This can be used as a basis for setting up a buildbot.
...
llvm-svn: 141337
2011-10-06 23:26:27 +00:00
ea8f5725c5
[analyzer] CmpRuns can now optionally delete empty reports.
...
llvm-svn: 139550
2011-09-12 22:40:36 +00:00
b80d836137
[analyzer] CmpRuns.cmpScanBuildResults() should be easy to call from other modules.
...
llvm-svn: 139543
2011-09-12 21:32:41 +00:00
03f3598ff1
Rename CmpRuns into CmpRuns.py so that it could be used as a module.
...
llvm-svn: 139540
2011-09-12 21:07:18 +00:00
63585ddf9d
Move ubiviz to analyzer directory
...
llvm-svn: 90213
2009-12-01 06:34:06 +00:00
1a9db99932
Add a simple tool for comparing two static analyzer runs, primarily for use from
...
buildbot.
llvm-svn: 78336
2009-08-06 21:15:33 +00:00
Ted Kremenek