[clangd] Extract scoring/ranking logic, and shave yaks.
Summary:
Code completion scoring was embedded in CodeComplete.cpp, which is bad:
- awkward to test. The mechanisms (extracting info from index/sema) can be
unit-tested well, the policy (scoring) should be quantitatively measured.
Neither was easily possible, and debugging was hard.
The intermediate signal struct makes this easier.
- hard to reuse. This is a bug in workspaceSymbols: it just presents the
results in the index order, which is not sorted in practice, it needs to rank
them!
Also, index implementations care about scoring (both query-dependent and
independent) in order to truncate result lists appropriately.
The main yak shaved here is the build() function that had 3 variants across
unit tests is unified in TestTU.h (rather than adding a 4th variant).
Reviewers: ilya-biryukov
Subscribers: klimek, mgorny, ioeric, MaskRay, jkorous, mgrang, cfe-commits
Differential Revision: https://reviews.llvm.org/D46524
llvm-svn: 332378
2018-05-16 01:43:27 +08:00
|
|
|
//===--- Quality.h - Ranking alternatives for ambiguous queries -*- C++-*-===//
|
|
|
|
//
|
|
|
|
// The LLVM Compiler Infrastructure
|
|
|
|
//
|
|
|
|
// This file is distributed under the University of Illinois Open Source
|
|
|
|
// License. See LICENSE.TXT for details.
|
|
|
|
//
|
|
|
|
//===---------------------------------------------------------------------===//
|
|
|
|
///
|
|
|
|
/// Some operations such as code completion produce a set of candidates.
|
|
|
|
/// Usually the user can choose between them, but we should put the best options
|
|
|
|
/// at the top (they're easier to select, and more likely to be seen).
|
|
|
|
///
|
|
|
|
/// This file defines building blocks for ranking candidates.
|
|
|
|
/// It's used by the features directly and also in the implementation of
|
|
|
|
/// indexes, as indexes also need to heuristically limit their results.
|
|
|
|
///
|
|
|
|
/// The facilities here are:
|
|
|
|
/// - retrieving scoring signals from e.g. indexes, AST, CodeCompletionString
|
|
|
|
/// These are structured in a way that they can be debugged, and are fairly
|
|
|
|
/// consistent regardless of the source.
|
|
|
|
/// - compute scores from scoring signals. These are suitable for sorting.
|
|
|
|
/// - sorting utilities like the TopN container.
|
|
|
|
/// These could be split up further to isolate dependencies if we care.
|
|
|
|
///
|
|
|
|
//===---------------------------------------------------------------------===//
|
|
|
|
#ifndef LLVM_CLANG_TOOLS_EXTRA_CLANGD_QUALITY_H
|
|
|
|
#define LLVM_CLANG_TOOLS_EXTRA_CLANGD_QUALITY_H
|
2018-07-23 18:56:37 +08:00
|
|
|
#include "clang/Sema/CodeCompleteConsumer.h"
|
2018-06-15 16:58:12 +08:00
|
|
|
#include "llvm/ADT/ArrayRef.h"
|
[clangd] Extract scoring/ranking logic, and shave yaks.
Summary:
Code completion scoring was embedded in CodeComplete.cpp, which is bad:
- awkward to test. The mechanisms (extracting info from index/sema) can be
unit-tested well, the policy (scoring) should be quantitatively measured.
Neither was easily possible, and debugging was hard.
The intermediate signal struct makes this easier.
- hard to reuse. This is a bug in workspaceSymbols: it just presents the
results in the index order, which is not sorted in practice, it needs to rank
them!
Also, index implementations care about scoring (both query-dependent and
independent) in order to truncate result lists appropriately.
The main yak shaved here is the build() function that had 3 variants across
unit tests is unified in TestTU.h (rather than adding a 4th variant).
Reviewers: ilya-biryukov
Subscribers: klimek, mgorny, ioeric, MaskRay, jkorous, mgrang, cfe-commits
Differential Revision: https://reviews.llvm.org/D46524
llvm-svn: 332378
2018-05-16 01:43:27 +08:00
|
|
|
#include "llvm/ADT/StringRef.h"
|
|
|
|
#include <algorithm>
|
|
|
|
#include <functional>
|
|
|
|
#include <vector>
|
|
|
|
namespace llvm {
|
|
|
|
class raw_ostream;
|
|
|
|
}
|
|
|
|
namespace clang {
|
|
|
|
class CodeCompletionResult;
|
|
|
|
namespace clangd {
|
|
|
|
struct Symbol;
|
2018-07-03 16:09:29 +08:00
|
|
|
class URIDistance;
|
[clangd] Extract scoring/ranking logic, and shave yaks.
Summary:
Code completion scoring was embedded in CodeComplete.cpp, which is bad:
- awkward to test. The mechanisms (extracting info from index/sema) can be
unit-tested well, the policy (scoring) should be quantitatively measured.
Neither was easily possible, and debugging was hard.
The intermediate signal struct makes this easier.
- hard to reuse. This is a bug in workspaceSymbols: it just presents the
results in the index order, which is not sorted in practice, it needs to rank
them!
Also, index implementations care about scoring (both query-dependent and
independent) in order to truncate result lists appropriately.
The main yak shaved here is the build() function that had 3 variants across
unit tests is unified in TestTU.h (rather than adding a 4th variant).
Reviewers: ilya-biryukov
Subscribers: klimek, mgorny, ioeric, MaskRay, jkorous, mgrang, cfe-commits
Differential Revision: https://reviews.llvm.org/D46524
llvm-svn: 332378
2018-05-16 01:43:27 +08:00
|
|
|
|
|
|
|
// Signals structs are designed to be aggregated from 0 or more sources.
|
|
|
|
// A default instance has neutral signals, and sources are merged into it.
|
|
|
|
// They can be dumped for debugging, and evaluate()d into a score.
|
|
|
|
|
|
|
|
/// Attributes of a symbol that affect how much we like it.
|
|
|
|
struct SymbolQualitySignals {
|
|
|
|
bool Deprecated = false;
|
2018-06-08 17:36:34 +08:00
|
|
|
bool ReservedName = false; // __foo, _Foo are usually implementation details.
|
|
|
|
// FIXME: make these findable once user types _.
|
[clangd] Extract scoring/ranking logic, and shave yaks.
Summary:
Code completion scoring was embedded in CodeComplete.cpp, which is bad:
- awkward to test. The mechanisms (extracting info from index/sema) can be
unit-tested well, the policy (scoring) should be quantitatively measured.
Neither was easily possible, and debugging was hard.
The intermediate signal struct makes this easier.
- hard to reuse. This is a bug in workspaceSymbols: it just presents the
results in the index order, which is not sorted in practice, it needs to rank
them!
Also, index implementations care about scoring (both query-dependent and
independent) in order to truncate result lists appropriately.
The main yak shaved here is the build() function that had 3 variants across
unit tests is unified in TestTU.h (rather than adding a 4th variant).
Reviewers: ilya-biryukov
Subscribers: klimek, mgorny, ioeric, MaskRay, jkorous, mgrang, cfe-commits
Differential Revision: https://reviews.llvm.org/D46524
llvm-svn: 332378
2018-05-16 01:43:27 +08:00
|
|
|
unsigned References = 0;
|
|
|
|
|
2018-06-06 16:53:36 +08:00
|
|
|
enum SymbolCategory {
|
2018-06-14 21:42:21 +08:00
|
|
|
Unknown = 0,
|
2018-06-06 16:53:36 +08:00
|
|
|
Variable,
|
|
|
|
Macro,
|
|
|
|
Type,
|
|
|
|
Function,
|
2018-07-24 16:51:52 +08:00
|
|
|
Constructor,
|
2018-06-06 16:53:36 +08:00
|
|
|
Namespace,
|
2018-06-14 21:42:21 +08:00
|
|
|
Keyword,
|
2018-06-06 16:53:36 +08:00
|
|
|
} Category = Unknown;
|
|
|
|
|
[clangd] Extract scoring/ranking logic, and shave yaks.
Summary:
Code completion scoring was embedded in CodeComplete.cpp, which is bad:
- awkward to test. The mechanisms (extracting info from index/sema) can be
unit-tested well, the policy (scoring) should be quantitatively measured.
Neither was easily possible, and debugging was hard.
The intermediate signal struct makes this easier.
- hard to reuse. This is a bug in workspaceSymbols: it just presents the
results in the index order, which is not sorted in practice, it needs to rank
them!
Also, index implementations care about scoring (both query-dependent and
independent) in order to truncate result lists appropriately.
The main yak shaved here is the build() function that had 3 variants across
unit tests is unified in TestTU.h (rather than adding a 4th variant).
Reviewers: ilya-biryukov
Subscribers: klimek, mgorny, ioeric, MaskRay, jkorous, mgrang, cfe-commits
Differential Revision: https://reviews.llvm.org/D46524
llvm-svn: 332378
2018-05-16 01:43:27 +08:00
|
|
|
void merge(const CodeCompletionResult &SemaCCResult);
|
|
|
|
void merge(const Symbol &IndexResult);
|
|
|
|
|
|
|
|
// Condense these signals down to a single number, higher is better.
|
|
|
|
float evaluate() const;
|
|
|
|
};
|
|
|
|
llvm::raw_ostream &operator<<(llvm::raw_ostream &,
|
|
|
|
const SymbolQualitySignals &);
|
|
|
|
|
|
|
|
/// Attributes of a symbol-query pair that affect how much we like it.
|
|
|
|
struct SymbolRelevanceSignals {
|
2018-06-06 20:38:37 +08:00
|
|
|
/// 0-1+ fuzzy-match score for unqualified name. Must be explicitly assigned.
|
[clangd] Extract scoring/ranking logic, and shave yaks.
Summary:
Code completion scoring was embedded in CodeComplete.cpp, which is bad:
- awkward to test. The mechanisms (extracting info from index/sema) can be
unit-tested well, the policy (scoring) should be quantitatively measured.
Neither was easily possible, and debugging was hard.
The intermediate signal struct makes this easier.
- hard to reuse. This is a bug in workspaceSymbols: it just presents the
results in the index order, which is not sorted in practice, it needs to rank
them!
Also, index implementations care about scoring (both query-dependent and
independent) in order to truncate result lists appropriately.
The main yak shaved here is the build() function that had 3 variants across
unit tests is unified in TestTU.h (rather than adding a 4th variant).
Reviewers: ilya-biryukov
Subscribers: klimek, mgorny, ioeric, MaskRay, jkorous, mgrang, cfe-commits
Differential Revision: https://reviews.llvm.org/D46524
llvm-svn: 332378
2018-05-16 01:43:27 +08:00
|
|
|
float NameMatch = 1;
|
|
|
|
bool Forbidden = false; // Unavailable (e.g const) or inaccessible (private).
|
2018-06-15 16:58:12 +08:00
|
|
|
|
2018-07-03 16:09:29 +08:00
|
|
|
URIDistance *FileProximityMatch = nullptr;
|
2018-06-15 16:58:12 +08:00
|
|
|
/// This is used to calculate proximity between the index symbol and the
|
|
|
|
/// query.
|
|
|
|
llvm::StringRef SymbolURI;
|
2018-06-05 20:22:43 +08:00
|
|
|
/// Proximity between best declaration and the query. [0-1], 1 is closest.
|
2018-06-15 16:58:12 +08:00
|
|
|
/// FIXME: unify with index proximity score - signals should be
|
|
|
|
/// source-independent.
|
|
|
|
float SemaProximityScore = 0;
|
[clangd] Extract scoring/ranking logic, and shave yaks.
Summary:
Code completion scoring was embedded in CodeComplete.cpp, which is bad:
- awkward to test. The mechanisms (extracting info from index/sema) can be
unit-tested well, the policy (scoring) should be quantitatively measured.
Neither was easily possible, and debugging was hard.
The intermediate signal struct makes this easier.
- hard to reuse. This is a bug in workspaceSymbols: it just presents the
results in the index order, which is not sorted in practice, it needs to rank
them!
Also, index implementations care about scoring (both query-dependent and
independent) in order to truncate result lists appropriately.
The main yak shaved here is the build() function that had 3 variants across
unit tests is unified in TestTU.h (rather than adding a 4th variant).
Reviewers: ilya-biryukov
Subscribers: klimek, mgorny, ioeric, MaskRay, jkorous, mgrang, cfe-commits
Differential Revision: https://reviews.llvm.org/D46524
llvm-svn: 332378
2018-05-16 01:43:27 +08:00
|
|
|
|
2018-06-06 00:30:25 +08:00
|
|
|
// An approximate measure of where we expect the symbol to be used.
|
|
|
|
enum AccessibleScope {
|
|
|
|
FunctionScope,
|
|
|
|
ClassScope,
|
|
|
|
FileScope,
|
|
|
|
GlobalScope,
|
|
|
|
} Scope = GlobalScope;
|
|
|
|
|
|
|
|
enum QueryType {
|
|
|
|
CodeComplete,
|
|
|
|
Generic,
|
|
|
|
} Query = Generic;
|
|
|
|
|
2018-07-23 18:56:37 +08:00
|
|
|
CodeCompletionContext::Kind Context = CodeCompletionContext::CCC_Other;
|
|
|
|
|
|
|
|
// Whether symbol is an instance member of a class.
|
|
|
|
bool IsInstanceMember = false;
|
|
|
|
|
[clangd] Extract scoring/ranking logic, and shave yaks.
Summary:
Code completion scoring was embedded in CodeComplete.cpp, which is bad:
- awkward to test. The mechanisms (extracting info from index/sema) can be
unit-tested well, the policy (scoring) should be quantitatively measured.
Neither was easily possible, and debugging was hard.
The intermediate signal struct makes this easier.
- hard to reuse. This is a bug in workspaceSymbols: it just presents the
results in the index order, which is not sorted in practice, it needs to rank
them!
Also, index implementations care about scoring (both query-dependent and
independent) in order to truncate result lists appropriately.
The main yak shaved here is the build() function that had 3 variants across
unit tests is unified in TestTU.h (rather than adding a 4th variant).
Reviewers: ilya-biryukov
Subscribers: klimek, mgorny, ioeric, MaskRay, jkorous, mgrang, cfe-commits
Differential Revision: https://reviews.llvm.org/D46524
llvm-svn: 332378
2018-05-16 01:43:27 +08:00
|
|
|
void merge(const CodeCompletionResult &SemaResult);
|
2018-06-06 00:30:25 +08:00
|
|
|
void merge(const Symbol &IndexResult);
|
[clangd] Extract scoring/ranking logic, and shave yaks.
Summary:
Code completion scoring was embedded in CodeComplete.cpp, which is bad:
- awkward to test. The mechanisms (extracting info from index/sema) can be
unit-tested well, the policy (scoring) should be quantitatively measured.
Neither was easily possible, and debugging was hard.
The intermediate signal struct makes this easier.
- hard to reuse. This is a bug in workspaceSymbols: it just presents the
results in the index order, which is not sorted in practice, it needs to rank
them!
Also, index implementations care about scoring (both query-dependent and
independent) in order to truncate result lists appropriately.
The main yak shaved here is the build() function that had 3 variants across
unit tests is unified in TestTU.h (rather than adding a 4th variant).
Reviewers: ilya-biryukov
Subscribers: klimek, mgorny, ioeric, MaskRay, jkorous, mgrang, cfe-commits
Differential Revision: https://reviews.llvm.org/D46524
llvm-svn: 332378
2018-05-16 01:43:27 +08:00
|
|
|
|
|
|
|
// Condense these signals down to a single number, higher is better.
|
|
|
|
float evaluate() const;
|
|
|
|
};
|
|
|
|
llvm::raw_ostream &operator<<(llvm::raw_ostream &,
|
|
|
|
const SymbolRelevanceSignals &);
|
|
|
|
|
|
|
|
/// Combine symbol quality and relevance into a single score.
|
|
|
|
float evaluateSymbolAndRelevance(float SymbolQuality, float SymbolRelevance);
|
|
|
|
|
|
|
|
/// TopN<T> is a lossy container that preserves only the "best" N elements.
|
|
|
|
template <typename T, typename Compare = std::greater<T>> class TopN {
|
|
|
|
public:
|
|
|
|
using value_type = T;
|
|
|
|
TopN(size_t N, Compare Greater = Compare())
|
|
|
|
: N(N), Greater(std::move(Greater)) {}
|
|
|
|
|
|
|
|
// Adds a candidate to the set.
|
|
|
|
// Returns true if a candidate was dropped to get back under N.
|
|
|
|
bool push(value_type &&V) {
|
|
|
|
bool Dropped = false;
|
|
|
|
if (Heap.size() >= N) {
|
|
|
|
Dropped = true;
|
|
|
|
if (N > 0 && Greater(V, Heap.front())) {
|
|
|
|
std::pop_heap(Heap.begin(), Heap.end(), Greater);
|
|
|
|
Heap.back() = std::move(V);
|
|
|
|
std::push_heap(Heap.begin(), Heap.end(), Greater);
|
|
|
|
}
|
|
|
|
} else {
|
|
|
|
Heap.push_back(std::move(V));
|
|
|
|
std::push_heap(Heap.begin(), Heap.end(), Greater);
|
|
|
|
}
|
|
|
|
assert(Heap.size() <= N);
|
|
|
|
assert(std::is_heap(Heap.begin(), Heap.end(), Greater));
|
|
|
|
return Dropped;
|
|
|
|
}
|
|
|
|
|
|
|
|
// Returns candidates from best to worst.
|
|
|
|
std::vector<value_type> items() && {
|
|
|
|
std::sort_heap(Heap.begin(), Heap.end(), Greater);
|
|
|
|
assert(Heap.size() <= N);
|
|
|
|
return std::move(Heap);
|
|
|
|
}
|
|
|
|
|
|
|
|
private:
|
|
|
|
const size_t N;
|
|
|
|
std::vector<value_type> Heap; // Min-heap, comparator is Greater.
|
|
|
|
Compare Greater;
|
|
|
|
};
|
|
|
|
|
2018-05-30 20:41:19 +08:00
|
|
|
/// Returns a string that sorts in the same order as (-Score, Tiebreak), for
|
|
|
|
/// LSP. (The highest score compares smallest so it sorts at the top).
|
[clangd] Extract scoring/ranking logic, and shave yaks.
Summary:
Code completion scoring was embedded in CodeComplete.cpp, which is bad:
- awkward to test. The mechanisms (extracting info from index/sema) can be
unit-tested well, the policy (scoring) should be quantitatively measured.
Neither was easily possible, and debugging was hard.
The intermediate signal struct makes this easier.
- hard to reuse. This is a bug in workspaceSymbols: it just presents the
results in the index order, which is not sorted in practice, it needs to rank
them!
Also, index implementations care about scoring (both query-dependent and
independent) in order to truncate result lists appropriately.
The main yak shaved here is the build() function that had 3 variants across
unit tests is unified in TestTU.h (rather than adding a 4th variant).
Reviewers: ilya-biryukov
Subscribers: klimek, mgorny, ioeric, MaskRay, jkorous, mgrang, cfe-commits
Differential Revision: https://reviews.llvm.org/D46524
llvm-svn: 332378
2018-05-16 01:43:27 +08:00
|
|
|
std::string sortText(float Score, llvm::StringRef Tiebreak = "");
|
|
|
|
|
|
|
|
} // namespace clangd
|
|
|
|
} // namespace clang
|
|
|
|
|
|
|
|
#endif
|