1406cdfbb7
ENH use the numbers module introduced in Python 2.6 to check for number types.
...
Fixes 1255.
2012-10-24 18:44:53 +02:00
07a9d2e6df
ENH better error messages in CountVectorizer for empty vocabulary
2012-10-06 14:08:08 +02:00
c877742ede
FIX unicode support in count vectorizer. Closes #1098 .
2012-09-20 15:36:38 +01:00
c4d9e87522
FIX error in error message ^^ closes #1155 .
2012-09-17 21:25:32 +01:00
65cf66540d
ENH remove some deprecated parameters / functions /estimators
2012-09-15 16:43:08 +01:00
9de51eadcf
add y to tfidf vectorizer
2012-09-12 20:21:27 +01:00
293392045a
ENH performance of TfidfTransformer
...
Moved construction of idf diagonal matrix from transform to fit.
TfidfVectorizer.transform now takes 25% less time on 20newsgroups test set;
did not profile transformer in isolation.
2012-09-08 22:54:28 +02:00
ef2f4acde7
Expose ENGLISH_STOP_WORDS
2012-09-04 18:00:49 +01:00
7f76aa1def
Add __all__ for half of the scikit
2012-09-04 18:00:49 +01:00
1cdc9e119a
DOC CountVectorizerDocstring readability
2012-09-02 11:32:30 +02:00
9e7c03f71a
Add or fix deprecation schedule in warnings.
2012-09-01 20:02:14 +02:00
f9d6b2fc82
ENH more robust testing for int
2012-09-01 14:29:35 +02:00
05630b0ae4
ENH added min_df keyword to CountVectorizer, default=2
2012-09-01 14:29:35 +02:00
c677f0bf91
Typo.
2012-08-21 15:38:37 +09:00
41564813af
ENH fix merge with char_wb_ngram
2012-08-19 14:40:05 +01:00
cd18098d1e
ENH addresses @ogrisel's comments
2012-08-19 14:26:09 +01:00
bf787ac11f
ENH renamed parameter bounds_n to ngram_range, fixed doctests and tests.
2012-08-19 14:26:09 +01:00
47c156295d
ENH renamed ``min_n`` and ``max_n`` parameters in CountVectorizer to enable gridsearch over them together.
2012-08-19 14:26:09 +01:00
8e0528d48e
Merge pull request #995 from kernc/CountVectorizer_analyzer_char_nospace
...
feature_extraction.text.CountVectorizer analyzer 'char_nospace'
2012-08-17 09:13:10 -07:00
b346184a77
changed 'char_nospace' keyword to shorter and meaningful 'char_wb'
2012-08-14 12:24:58 +02:00
1f0daf94d4
DOC add parameters to TfidfTransformer docstring
2012-08-13 11:31:56 +01:00
fdf6bfa26b
DOC added ``lowercase`` to CountVectorizer docstring.
2012-08-11 15:04:59 +01:00
08338cf825
char_nspace -> char_nospace, thanks Lars
2012-08-03 04:01:55 +02:00
ed89ddf4f6
replaced str.format() with string concatenation as it's 3 times faster
2012-08-03 03:56:22 +02:00
9f0ec0b811
missing unicode modifier
2012-08-03 00:34:43 +02:00
e83fe8bf9a
words for n-grams padded with one space on each side
2012-08-03 00:26:16 +02:00
8b2893eb39
Oneliner docstring
2012-08-02 23:48:05 +02:00
7db59b1ce8
feature_extraction.text.CountVectorizer analyzer 'char_nospace'
...
creates character n-grams but only inside word boundaries, e.g.
'this is it' to 3-grams: ['thi', 'his', 'is', 'it']
2012-08-02 22:00:41 +02:00
f4882b5c38
DOC + TST vocabulary arg in CountVect docstring
...
Somewhere during the last refactoring, the documentation for the argument
went missing.
Also, check for Mapping subclass instead of hasattr "get" and test with a
few different types.
2012-08-01 15:09:35 +02:00
78517a3399
COSMIT: Use np.array.fill for scalar values.
2012-07-17 23:18:38 -07:00
e2ce08edd1
DOC typo in docstring
2012-06-13 16:18:46 +02:00
be8904061f
useless import
2012-03-07 08:08:34 -08:00
d9fd053033
fixed and inheritance bug in TfidfVectorizer.fit_transform + removed vocabulary backward compat that breaks grid_search
2012-03-07 08:07:47 -08:00
5d0ea6cf6d
updated what's new + backward compat for vocabulary attribute
2012-03-07 07:12:00 -08:00
c0541fa03b
Renamed Vectorizer to TfidfVectorizer + deprecation warning
2012-03-07 06:48:56 -08:00
c68623210a
remove lambda + better comment position
2012-03-06 07:30:11 +01:00
25a9c4e5d4
update strip_accents in Vectorizer as well
2012-03-06 02:35:36 +01:00
3872d44900
No accent stripping by default + various doc fixes
2012-03-06 02:15:28 +01:00
5fe1cc449a
DOC: updated parameters
2012-03-06 00:42:32 +01:00
0d1daad65a
FIX: division by zero errors and negative IDF
2012-03-05 23:25:19 +01:00
1216bc5a6d
Make Vectorizer not inherit from TfidfTransformer while preserving direct gridsearchability
2012-03-05 21:08:03 +01:00
864e4fb155
ENH: remove useless array wrap for feature names + more TF-IDF tests
2012-03-05 20:34:45 +01:00
a307e45648
Filter stop words before ngrams
2012-03-05 10:57:42 +01:00
1f542c29d2
finally the right API with plenty of efficient overrides
2012-03-04 21:58:38 +01:00
267015f36e
switch back to the old vocabulary constructor argument
2012-03-04 20:00:13 +01:00
0dd256b220
Merge remote-tracking branch 'upstream/master' into text-feature-extraction-simplification
2012-03-04 18:56:30 +01:00
667ef37714
DOC move references from Notes to References section in docstrings
2012-03-04 15:16:51 +01:00
28471b6d2a
Flatten the combined vectorizer as well
2012-03-04 10:37:16 +01:00
0e8c229749
DOC: improve docstring for Vectorizer
2012-03-04 10:06:29 +01:00
9f6cdc038c
make CountVectorizer able to output binary occurrence info
2012-03-03 19:53:21 +01:00
Andreas Mueller