4366ba500d
use sklearn.utils.random
2015-09-16 15:24:28 -07:00
4af0c49f27
vocabulary of type set now coerced to list to preserve iteration ordering after serialization
2015-09-16 15:24:28 -07:00
250e509e86
ENH O(1) stop-word lookup when list provided
...
The docstring says stop_words can be a list, but it should be accessed as a set.
2015-08-08 22:55:13 +10:00
cd2ee7e454
MAINT docstring --> comments to prevent nose from using doc in verbose mode
2015-03-21 11:16:49 +05:30
f1b8283c95
catch some warnings, be less verbose in testing.
2015-03-02 14:40:35 -05:00
dbc5d707c6
Change loss names for LinearSVC and LinearSVR()
...
the names are now consistent across methods
In LinearSVC:
'l1' -> 'hinge'
'l2' -> 'squared_hinge'
In LinearSVR:
'l1' -> 'epsilon_insensitive'
'l2' -> 'squared_epsilon_insensitive'
2015-02-09 11:09:16 +01:00
21369dd6a1
TST Removal or modification of stop_words_ should not affect transform.
...
DOC Add a line to {Count, Tfidf}Vectorizer about removal of stop_words_
DOC Add documentation of stop_words_ attr in TfidfVectorizer
2015-02-02 02:20:04 +05:30
cd7b43ccf9
TST make catch_warnings blocks more robust
2014-10-12 18:20:18 +02:00
8680a6bae1
Deprecate vectorizer fixed_vocabulary attribute
2014-08-13 10:54:44 +02:00
143e5ffc37
FIX set vectorizer vocabulary outside of init
2014-08-13 10:54:44 +02:00
56057c9630
MAINT remove deprecated code
2014-07-23 16:19:40 +02:00
4bf824cd7e
TST non-regression test for CV on text pipelines
2014-07-16 16:35:41 +02:00
f208316de6
Added a comment to explain the use of a test.
2014-07-14 22:13:41 +02:00
fb62b9fa7e
Replaced assert_raises with assert_raise_message as the point is to make sure the exception message is clear.
2014-07-14 16:08:56 +02:00
d1fe163bbc
PEP8 line length fix.
2014-07-14 15:26:12 +02:00
6e2af35483
Added a test on hashing vectorizer behavior with np.nan input.
2014-07-14 15:23:21 +02:00
92add1daa1
FIX TfidfVectorizer exports idf_ attribute
2014-05-23 17:51:15 +08:00
39b859b95e
FIX TfidfVectorizer to no longer ignore binary param
...
Also changed the docs to clarify that binary=True means
binary tf, not binary output.
2014-03-24 11:18:11 +01:00
dbc26ce996
COSMIT remove unused imports and variables
2014-02-03 19:43:56 +11:00
6ebcf4d020
COSMIT fix PEP8 errors
2014-02-02 00:30:28 +11:00
0bd0552bdf
ENH: Raise explicitly on non-unique vocab.
2013-12-09 23:15:54 +01:00
4c10c82dbb
ENH: address discussion
2013-11-29 13:55:39 +01:00
e1bdd99ea6
ENH: add assert_warn_message
2013-11-29 13:55:39 +01:00
d2f3a8a3da
ENH: refactor warnings 1
2013-11-29 13:55:38 +01:00
da4f2c6357
FIX regression in CountVectorizer handling of float min_df/max_df
...
Fixes #2595 .
2013-11-18 18:42:15 +01:00
baad8de295
COSMIT pyflakes feature_extraction.text tests
2013-10-02 19:10:37 +02:00
94d66a0e38
FIX max_features in CountVectorizer
...
Fixes #2443 : max_features would be selected based on document frequency
rather than term frequency.
2013-10-02 19:10:37 +02:00
c2cf21d8e7
FIX+TST non-consecutive or duplicate vocabulary indices
...
* added extra checks for custom vocab in CountVectorizer
* added test for custom vocab to check fauly vocabs
Fixes #2357 .
2013-08-15 12:52:52 +02:00
a29392eaa8
TST catch deprecation warning in feature_extraction.text
2013-07-26 10:17:50 +02:00
8c9dbc99dc
TST added tests for encoding/charset deprecation
...
Checking the old interface still works.
2013-07-26 10:01:05 +02:00
88fd230439
MAINT charset is deprecated in favor of encoding
...
closes #2107
2013-07-26 09:30:58 +02:00
5d8a4d909d
TST test CountVectorizer.stop_words_ value
2013-05-07 14:43:04 +02:00
09f2d90262
P3K make feature_extraction.text work
...
All tests pass with Py2 and Py3.
2013-03-10 22:20:29 +01:00
3d4519106a
ENH set min_df in fe.text back to 1
...
2 is simply too confusing for users, since it causes trivial examples
to fail.
2013-03-05 11:37:32 +01:00
cc4c3c3191
BUG restore empty vocabulary exc in CountVectorizer
2013-03-02 13:45:45 +01:00
1967a0b323
P3K use six to have a python 2 & 3 compatible code base
2013-02-09 18:08:44 +01:00
2297306edf
COSMIT pep8
2013-02-08 22:10:40 +01:00
c8e8614140
MV _check_stop_list tests to CV get_stop_words
2013-02-08 10:54:23 +13:00
0520ecc666
RM CV import
2013-02-08 10:41:20 +13:00
b3e6751112
MV Mixin tests to CountVectorizer tests
2013-02-08 10:39:56 +13:00
9a5c70cbae
ADD test for TfidfVectorizer attribute setters
2013-02-07 12:00:05 +13:00
96f79fddb7
ADD test for tfidf fit with incompatible n_features
2013-02-07 11:36:42 +13:00
f259bf4132
ADD test for get_feature_names
2013-02-07 11:36:42 +13:00
9a012e879c
ADD another VectorizerMixin test
2013-02-07 11:36:39 +13:00
789d1d33f5
ADD test cases to fill out VectorizerMixin coverage
2013-02-07 11:36:35 +13:00
72cce3561b
ADD test coverage for _check_stop_list
2013-02-07 11:36:20 +13:00
f7c79fb88f
test case for unfitted idf vector
2013-02-05 20:00:57 +13:00
f10cb47ad4
Add fit_transform support using the TransformerMixin + missing ABCMeta marker
2013-01-20 13:04:46 +01:00
d3a0aaa7a9
Initial work on hashing vectorizer
2013-01-20 13:04:46 +01:00
754c2d9533
COSMIT pep8
2012-12-22 16:48:17 +01:00
Cindy Sridharan