Lars Buitinck
669f31e9d6
TST CountVectorizer with empty vocabulary
2012-10-07 15:32:46 +02:00
Andreas Mueller
c877742ede
FIX unicode support in count vectorizer. Closes #1098 .
2012-09-20 15:36:38 +01:00
Vlad Niculae
3f8b454b4b
FIX: randomly failing CountVectorizer test
2012-09-01 22:36:43 +03:00
Andreas Mueller
05630b0ae4
ENH added min_df keyword to CountVectorizer, default=2
2012-09-01 14:29:35 +02:00
Andreas Mueller
41564813af
ENH fix merge with char_wb_ngram
2012-08-19 14:40:05 +01:00
Andreas Mueller
bf787ac11f
ENH renamed parameter bounds_n to ngram_range, fixed doctests and tests.
2012-08-19 14:26:09 +01:00
Andreas Mueller
47c156295d
ENH renamed ``min_n`` and ``max_n`` parameters in CountVectorizer to enable gridsearch over them together.
2012-08-19 14:26:09 +01:00
Kernc
b346184a77
changed 'char_nospace' keyword to shorter and meaningful 'char_wb'
2012-08-14 12:24:58 +02:00
Kernc
e83fe8bf9a
words for n-grams padded with one space on each side
2012-08-03 00:26:16 +02:00
Kernc
7db59b1ce8
feature_extraction.text.CountVectorizer analyzer 'char_nospace'
...
creates character n-grams but only inside word boundaries, e.g.
'this is it' to 3-grams: ['thi', 'his', 'is', 'it']
2012-08-02 22:00:41 +02:00
Lars Buitinck
f4882b5c38
DOC + TST vocabulary arg in CountVect docstring
...
Somewhere during the last refactoring, the documentation for the argument
went missing.
Also, check for Mapping subclass instead of hasattr "get" and test with a
few different types.
2012-08-01 15:09:35 +02:00
Lars Buitinck
f6bd86e290
COSMIT cleanup tests with pyflakes
2012-07-21 12:57:49 +02:00
Yaroslav Halchenko
37b440e071
ENH do not fail the test reslying on numpy div 0 warnings if those are not spit out by numpy in general
2012-07-04 00:40:04 -04:00
Andreas Mueller
1ebcc4a486
COSMIT pep8
2012-05-15 21:18:30 +02:00
Subhodeep Moitra
2727820e6a
P3K: Fixed RuntimeError.message
2012-05-11 11:24:27 +02:00
Subhodeep Moitra
ad66a25f5a
P3K: Modified RuntimeError message args
2012-05-11 11:21:01 +02:00
Andreas Mueller
3e5f2e5e08
ENH backport "assert_less" and "assert_greater", rename "assert_lower" and use it everywhere :)
2012-05-06 15:43:29 +02:00
Olivier Grisel
d9fd053033
fixed and inheritance bug in TfidfVectorizer.fit_transform + removed vocabulary backward compat that breaks grid_search
2012-03-07 08:07:47 -08:00
Olivier Grisel
c0541fa03b
Renamed Vectorizer to TfidfVectorizer + deprecation warning
2012-03-07 06:48:56 -08:00
Olivier Grisel
3872d44900
No accent stripping by default + various doc fixes
2012-03-06 02:15:28 +01:00
Olivier Grisel
0d1daad65a
FIX: division by zero errors and negative IDF
2012-03-05 23:25:19 +01:00
Olivier Grisel
1216bc5a6d
Make Vectorizer not inherit from TfidfTransformer while preserving direct gridsearchability
2012-03-05 21:08:03 +01:00
Olivier Grisel
864e4fb155
ENH: remove useless array wrap for feature names + more TF-IDF tests
2012-03-05 20:34:45 +01:00
Olivier Grisel
1f542c29d2
finally the right API with plenty of efficient overrides
2012-03-04 21:58:38 +01:00
Olivier Grisel
267015f36e
switch back to the old vocabulary constructor argument
2012-03-04 20:00:13 +01:00
Olivier Grisel
28471b6d2a
Flatten the combined vectorizer as well
2012-03-04 10:37:16 +01:00
Olivier Grisel
fdb7844bf1
add a test for custom dtype
2012-03-03 19:57:39 +01:00
Olivier Grisel
9f6cdc038c
make CountVectorizer able to output binary occurrence info
2012-03-03 19:53:21 +01:00
Olivier Grisel
38d4332293
factorize feature names array
2012-03-03 19:19:33 +01:00
Olivier Grisel
a510d17a05
Flatten the feature extraction API
2012-03-03 17:20:32 +01:00
Andreas Mueller
aaa6611614
COSMIT pep8
2012-02-17 16:49:48 +01:00
Robert Layton
64662c395e
Test now works, testing both the Word and Char analyzers
2012-02-16 07:35:42 +11:00
Robert Layton
d961bc2f35
Added a test (that doesn't work yet)
...
unicode_error renamed to decode_error
2012-02-15 21:41:16 +11:00
Alexandre Gramfort
ad8e4912cb
TST: use assert_true instead of assert + remove some relative imports
2012-02-11 15:43:03 +01:00
Lars Buitinck
654a39cf15
ENH more generic dict-like test in CountVectorizer
...
Includes test.
2012-02-07 17:11:03 +01:00
Lars Buitinck
5e92beb694
ENH sublinear tf scaling in TfidfTransformer
2012-02-04 16:51:40 +01:00
Lars Buitinck
b2239332f5
COSMIT fix ugly import, left over from LinearSVC refactoring
2012-01-17 09:22:58 +01:00
Lars Buitinck
9b0fbab0d1
ENH merge dense/sparse LinearSVC, part 3: deprecate sparse.LinearSVC
2012-01-16 18:27:14 +01:00
Andreas Mueller
68a8b8b46d
ENH renamed best_estimator and best_score in examples and tests.
2012-01-05 23:35:33 +01:00
Olivier Grisel
ee4c2043ad
FIX: incomplete test for inverse_transform in text feature extraction
2012-01-02 10:12:32 +01:00
Lars Buitinck
f116314f5c
Revert "BUG Disallow negative tf-idf weight"
...
This reverts commit 617d731918 .
Breaks other tests; let's live with the negative tf-idf weights for now.
2011-12-24 22:03:27 +01:00
Xinfan Meng
617d731918
BUG Disallow negative tf-idf weight
...
Add the same smoothing count to n_samples to avoid negative weight.
2011-12-24 21:40:15 +01:00
Andreas Mueller
d0854d5a07
COSMIT pep8
2011-12-15 17:08:30 +01:00
Gael varoquaux
8118f6efde
BUG: vectorizer.inverse_transform on arrays
...
Matrices and arrays have different indexing rules: matrices are always 2D
objects, thus slicing a matrix returns a 2D object.
2011-11-07 09:12:33 +01:00
Olivier Grisel
cc678ade87
typo: s/accurracy/accuracy/g
2011-09-21 18:44:26 +02:00
Fabian Pedregosa
ddf4b72109
Move project directory from scikits.learn to sklearn
2011-09-02 12:06:57 +02:00
Fabian Pedregosa
68f27e3790
Revert "Move project directory from scikits.learn to sklearn"
...
This reverts commit fd0d3b879d .
2011-09-02 12:03:18 +02:00
Fabian Pedregosa
fd0d3b879d
Move project directory from scikits.learn to sklearn
2011-09-02 11:38:24 +02:00