69e2bf9e0c
[analyzer] Test SimpleStream on the buildbot.
...
llvm-svn: 167317
2012-11-02 21:30:07 +00:00
639b40484e
[analyzer] CmpRuns: cleanup APIs, allow processing of plists with no
...
clang_version, fix the compare routine.
llvm-svn: 166129
2012-10-17 21:09:26 +00:00
93283d0933
[analyzer] Expose clang_version in CmpRuns
...
llvm-svn: 166048
2012-10-16 19:36:39 +00:00
c80313b888
[analyzer] CmpRuns - cleaned up the API, added relative path getter
...
llvm-svn: 165995
2012-10-15 22:48:21 +00:00
dc1f6bc454
Add handy script for updating plist FileCheck expected output for
...
analyzer tests.
llvm-svn: 163486
2012-09-10 06:19:34 +00:00
a2f970baa6
[analyzer] testing: add a build mode to allow C++11 testing.
...
llvm-svn: 163357
2012-09-06 23:30:27 +00:00
9858b12381
Revert "[analyzer] Disable diagnostic checking on the buildbot."
...
This reverts commit befc0f648c83f65e1f3567f2058c7c18b4bc3ad8 now that
plist-html diagnostics are working again.
llvm-svn: 162966
2012-08-31 00:36:30 +00:00
5e2f0b2151
[analyzer] Disable diagnostic checking on the buildbot.
...
Due to recent diagnostic changes, we may generate malformed diagnostics.
llvm-svn: 162940
2012-08-30 21:04:09 +00:00
07a821fb17
[analyzer] Fixup 162863.
...
Thanks Jordan.
llvm-svn: 162875
2012-08-29 23:23:39 +00:00
f329823dc0
[analyzer]Fix typo, unbreak static analyzer BuildBot (at least
...
partially).
(Addresses a regression from r162790.)
llvm-svn: 162864
2012-08-29 21:22:40 +00:00
f9a539d858
Automatically use more cores when the test build uses 'make'.
...
llvm-svn: 162790
2012-08-28 20:40:04 +00:00
42c14428d2
Consolidate helper methods and configuration logic. No functionality change.
...
llvm-svn: 162789
2012-08-28 20:40:02 +00:00
6cb2080e5e
Pass --use-analyzer to scan-build when running within the test harness.
...
llvm-svn: 162783
2012-08-28 20:20:52 +00:00
4220144acb
experimental.security.taint is now alpha.security.taint
...
llvm-svn: 162775
2012-08-28 18:45:22 +00:00
7d2babc046
[analyzer] More internal stats collection.
...
llvm-svn: 162687
2012-08-27 18:38:32 +00:00
e12365bc27
[analyzer] Ted fixed the plist-html issue, so the assert can go away.
...
llvm-svn: 162598
2012-08-24 21:07:49 +00:00
af3ae3cbbd
[analyzer] Unbreak the static analyzer buildbot.
...
We no longer associate the correct HTML file with plist diagnostic.
Fall out from r162028.
llvm-svn: 162071
2012-08-17 01:09:13 +00:00
45a992b5f0
[analyzer] CmpRuns should include file name in the issue identifier.
...
This prevents us from treating the issues from different files with the
same function names and same offsets as the same.
The issue identifier now includes the file name. Also added a way to
strip off the root directories form the source file names.
llvm-svn: 161150
2012-08-02 00:41:40 +00:00
c2a3223da9
SATestBuild should not ask for non-existent checkers.
...
- "cocoa" was moved to "osx.cocoa" a long time ago.
- "cplusplus" would be a valid package except we don't have any C++ checkers.
llvm-svn: 160821
2012-07-26 22:31:59 +00:00
5920a1bdd1
Un-break standalone invocations of CmpRuns.py.
...
Fallout from CmpRuns.py API changes in r160314.
llvm-svn: 160800
2012-07-26 20:03:51 +00:00
9b7d7140ef
[analyzer] Make CmpRuns external-user friendly.
...
CmpRuns can be used for static analyzer bug report comparison. However,
we want to make sure external users do not rely on the way bugs are
represented (plist files). Make sure that we have a user
friendly/documented API for CmpRuns script.
llvm-svn: 160314
2012-07-16 20:21:42 +00:00
40b87fc1f9
[analyzer] Add a statistic for maximum CFG size and a script to summarize analyzer stats from scan-build output.
...
llvm-svn: 159776
2012-07-05 20:44:02 +00:00
d60367b893
[analyzer] Use "issue hash" in CmpRuns; followup on r158180
...
(For the future: It would be more efficient to produce a hash key with
the embedded function info inside the compiler.)
llvm-svn: 158187
2012-06-08 01:50:49 +00:00
dc191a184f
[analyzer] SATestBuild should execute SVN updates even if Verbose is off.
...
Also, re-use glob results when looking for failure logs.
llvm-svn: 157817
2012-06-01 16:24:43 +00:00
01ac57244c
[analyzer] Fix SATestAdd to work with SATestBuild.
...
Also, eliminate global 'IsReferenceBuild' in SATestBuild. It doesn't get
passed around that much.
llvm-svn: 157816
2012-06-01 16:24:38 +00:00
f5958eb2b4
Fix typo.
...
llvm-svn: 157229
2012-05-22 00:54:40 +00:00
c53ed2e158
Use Perl prototypes instead of shift.
...
llvm-svn: 157228
2012-05-22 00:52:49 +00:00
2fe1ed3e0d
Add basic delta-debugging script used for reducing analyzer crasher test cases.
...
llvm-svn: 157219
2012-05-21 23:29:01 +00:00
6ecb6a6b7f
[analyzer] Testing: These checkers are not experimental anymore.
...
llvm-svn: 150989
2012-02-20 21:10:40 +00:00
a432feaf26
[analyzer] Add the Malloc checker to the list of tested checkers.
...
llvm-svn: 150535
2012-02-15 00:19:07 +00:00
4c1ef976a8
[analyzer] Testing: add automated reference results reset.
...
llvm-svn: 149682
2012-02-03 06:35:23 +00:00
97981bdeb0
[analyzer] Testing: add 2 new checkers to the buildbot script.
...
llvm-svn: 149514
2012-02-01 16:46:57 +00:00
b3d896d333
[analyzer] Add the HTML file to the SATest diagnostic diff.
...
(Uses the functionality which has been in CmpRuns long before.)
llvm-svn: 148868
2012-01-24 21:57:35 +00:00
895c312404
[analyzer] Testing: make diagnostic diffs more informative (add
...
diagnostic message).
llvm-svn: 148867
2012-01-24 21:57:32 +00:00
a08c6b7efc
[analyzer] Unbreak the static analyzer bot. Regression from r148558.
...
When we build a single source file, we call clang directly (not though scan-build).
llvm-svn: 148612
2012-01-21 01:11:35 +00:00
7a75cf32a2
[analyzer] Tweak the buildbot script to include the experimental taint checker and correct the checker enabling setting.
...
llvm-svn: 148558
2012-01-20 19:10:59 +00:00
de1f7f8bfb
[analyzer] Testing infrastructure: Flush output after every print
...
statement.
llvm-svn: 147862
2012-01-10 18:10:25 +00:00
5acd9603da
[analyzer] Correct the error message in the testing infrastructure.
...
llvm-svn: 147568
2012-01-04 23:53:50 +00:00
26573c5585
[analyzer] Testing: test with all the non-experimental checker packages.
...
llvm-svn: 144142
2011-11-08 22:41:25 +00:00
a1b56e2aa3
[analyzer] Testing: support for regenerate reference output
...
Change the flow of the SATestAdd so that it could be used for regenerating
the reference output without exiting with an error.
llvm-svn: 144141
2011-11-08 22:41:22 +00:00
767d356f87
[analyzer] Testing: Display the number of reported differences in the main log.
...
llvm-svn: 144113
2011-11-08 19:56:31 +00:00
ae9d54bcf3
[analyzer] Testing infrastructure: flush the output between projects.
...
llvm-svn: 144051
2011-11-08 00:27:56 +00:00
84726dd72c
[analyzer] Relax the cmp criteria for analyzer reports.
...
Until we find out a way to easily find out what changed by looking at the logs.
llvm-svn: 143789
2011-11-05 05:20:56 +00:00
4720a730f6
[analyzer] Add support for testing with individual preprocessed files.
...
llvm-svn: 143786
2011-11-05 05:20:48 +00:00
42a4463091
[analyzer] Tweak the test script
...
Rename the pre_run_static_analyzer script into cleanup_run_static_analyzer
and use it to clean up after the reference build - which is done as part of
adding a new project to the system.
llvm-svn: 143568
2011-11-02 20:46:50 +00:00
f0c4116202
[analyzer] Static Analyzer Qualification Infrastructure: Scripts to support basic testing of the analyzer on external projects. This can be used as a basis for setting up a buildbot.
...
llvm-svn: 141337
2011-10-06 23:26:27 +00:00
ea8f5725c5
[analyzer] CmpRuns can now optionally delete empty reports.
...
llvm-svn: 139550
2011-09-12 22:40:36 +00:00
b80d836137
[analyzer] CmpRuns.cmpScanBuildResults() should be easy to call from other modules.
...
llvm-svn: 139543
2011-09-12 21:32:41 +00:00
03f3598ff1
Rename CmpRuns into CmpRuns.py so that it could be used as a module.
...
llvm-svn: 139540
2011-09-12 21:07:18 +00:00
63585ddf9d
Move ubiviz to analyzer directory
...
llvm-svn: 90213
2009-12-01 06:34:06 +00:00
Anna Zaks