llvm-project/clang/unittests
Raphael Isemann 70686a1590 [analyzer] Performance optimizations for the CloneChecker
Summary:
This patch  aims at optimizing the CloneChecker for larger programs. Before this
patch we took around 102 seconds to analyze sqlite3 with a complexity value of
50. After this patch we now take 2.1 seconds to analyze sqlite3.

The biggest performance optimization is that we now put the constraint for group
size before the constraint for the complexity. The group size constraint is much
faster in comparison to the complexity constraint as it only does a simple
integer comparison. The complexity constraint on the other hand actually
traverses each Stmt and even checks the macro stack, so it is obviously not able
to handle larger amounts of incoming clones. The new order filters out all the
single-clone groups that the type II constraint generates in a faster way before
passing the fewer remaining clones to the complexity constraint. This reduced
runtime by around 95%.

The other change is that we also delay the verification part of the type II
clones back in the chain of constraints. This required to split up the
constraint into two parts - a verification and a hash constraint (which is also
making it more similar to the original design of the clone detection algorithm).
The reasoning for this is the same as before: The verification constraint has to
traverse many statements and shouldn't be at the start of the constraint chain.
However, as the type II hashing has to be the first step in our algorithm, we
have no other choice but split this constrain into two different ones. Now our
group size and complexity constrains filter out a chunk of the clones before
they reach the slow verification step, which reduces the runtime by around 8%.

I also kept the full type II constraint around - that now just calls it's two
sub-constraints - in case someone doesn't care about the performance benefits
of doing this.

Reviewers: NoQ

Reviewed By: NoQ

Subscribers: klimek, v.g.vassilev, xazax.hun, cfe-commits

Differential Revision: https://reviews.llvm.org/D34182

llvm-svn: 312222
2017-08-31 07:10:46 +00:00
..
AST [analyzer] Make StmtDataCollector customizable 2017-08-23 16:28:26 +00:00
ASTMatchers PR19668, PR23034: Fix handling of move constructors and deleted copy 2017-08-16 01:49:53 +00:00
Analysis [analyzer] Performance optimizations for the CloneChecker 2017-08-31 07:10:46 +00:00
Basic [Basic] Add a DiagnosticError llvm::ErrorInfo subclass 2017-08-25 15:48:00 +00:00
CodeGen ClangCodeGenTests: Update libdeps. 2017-08-27 11:46:05 +00:00
Driver Use class to pass information about executable name 2017-08-29 05:22:26 +00:00
Format clang-format: Add preprocessor directive indentation 2017-08-30 14:34:57 +00:00
Frontend [Frontend] Fix printing policy for AST context loaded from file 2017-08-25 18:07:03 +00:00
Lex [Lexer] Finding beginning of token with escaped new line 2017-08-10 10:06:16 +00:00
Rename Use add_clang_unittest in the CMakeLists.txt for the moved unittest 2017-06-30 16:43:00 +00:00
Rewrite Remove autoconf support 2016-01-26 21:30:40 +00:00
Sema [Sema] Allow an external sema source to handle delayed typo corrections. 2016-05-19 10:46:10 +00:00
StaticAnalyzer Add a method to get the list of registered static analyzer checkers. 2016-11-08 07:23:32 +00:00
Tooling Avoid 'size_t' typedef in the unittest ObjC code 2017-08-30 15:37:30 +00:00
libclang Fixed more signed/unsigned mismatch warnings introduced in my change at r279076 2016-08-18 20:56:48 +00:00
CMakeLists.txt [refactor] Move clang-rename into the clang repository 2017-06-30 16:36:09 +00:00