Commit Graph

48 Commits

Author SHA1 Message Date
Lars Buitinck 669f31e9d6 TST CountVectorizer with empty vocabulary 2012-10-07 15:32:46 +02:00
Andreas Mueller c877742ede FIX unicode support in count vectorizer. Closes #1098. 2012-09-20 15:36:38 +01:00
Vlad Niculae 3f8b454b4b FIX: randomly failing CountVectorizer test 2012-09-01 22:36:43 +03:00
Andreas Mueller 05630b0ae4 ENH added min_df keyword to CountVectorizer, default=2 2012-09-01 14:29:35 +02:00
Andreas Mueller 41564813af ENH fix merge with char_wb_ngram 2012-08-19 14:40:05 +01:00
Andreas Mueller bf787ac11f ENH renamed parameter bounds_n to ngram_range, fixed doctests and tests. 2012-08-19 14:26:09 +01:00
Andreas Mueller 47c156295d ENH renamed ``min_n`` and ``max_n`` parameters in CountVectorizer to enable gridsearch over them together. 2012-08-19 14:26:09 +01:00
Kernc b346184a77 changed 'char_nospace' keyword to shorter and meaningful 'char_wb' 2012-08-14 12:24:58 +02:00
Kernc e83fe8bf9a words for n-grams padded with one space on each side 2012-08-03 00:26:16 +02:00
Kernc 7db59b1ce8 feature_extraction.text.CountVectorizer analyzer 'char_nospace'
creates character n-grams but only inside word boundaries, e.g.
'this is it' to 3-grams: ['thi', 'his', 'is', 'it']
2012-08-02 22:00:41 +02:00
Lars Buitinck f4882b5c38 DOC + TST vocabulary arg in CountVect docstring
Somewhere during the last refactoring, the documentation for the argument
went missing.
Also, check for Mapping subclass instead of hasattr "get" and test with a
few different types.
2012-08-01 15:09:35 +02:00
Lars Buitinck f6bd86e290 COSMIT cleanup tests with pyflakes 2012-07-21 12:57:49 +02:00
Yaroslav Halchenko 37b440e071 ENH do not fail the test reslying on numpy div 0 warnings if those are not spit out by numpy in general 2012-07-04 00:40:04 -04:00
Andreas Mueller 1ebcc4a486 COSMIT pep8 2012-05-15 21:18:30 +02:00
Subhodeep Moitra 2727820e6a P3K: Fixed RuntimeError.message 2012-05-11 11:24:27 +02:00
Subhodeep Moitra ad66a25f5a P3K: Modified RuntimeError message args 2012-05-11 11:21:01 +02:00
Andreas Mueller 3e5f2e5e08 ENH backport "assert_less" and "assert_greater", rename "assert_lower" and use it everywhere :) 2012-05-06 15:43:29 +02:00
Olivier Grisel d9fd053033 fixed and inheritance bug in TfidfVectorizer.fit_transform + removed vocabulary backward compat that breaks grid_search 2012-03-07 08:07:47 -08:00
Olivier Grisel c0541fa03b Renamed Vectorizer to TfidfVectorizer + deprecation warning 2012-03-07 06:48:56 -08:00
Olivier Grisel 3872d44900 No accent stripping by default + various doc fixes 2012-03-06 02:15:28 +01:00
Olivier Grisel 0d1daad65a FIX: division by zero errors and negative IDF 2012-03-05 23:25:19 +01:00
Olivier Grisel 1216bc5a6d Make Vectorizer not inherit from TfidfTransformer while preserving direct gridsearchability 2012-03-05 21:08:03 +01:00
Olivier Grisel 864e4fb155 ENH: remove useless array wrap for feature names + more TF-IDF tests 2012-03-05 20:34:45 +01:00
Olivier Grisel 1f542c29d2 finally the right API with plenty of efficient overrides 2012-03-04 21:58:38 +01:00
Olivier Grisel 267015f36e switch back to the old vocabulary constructor argument 2012-03-04 20:00:13 +01:00
Olivier Grisel 28471b6d2a Flatten the combined vectorizer as well 2012-03-04 10:37:16 +01:00
Olivier Grisel fdb7844bf1 add a test for custom dtype 2012-03-03 19:57:39 +01:00
Olivier Grisel 9f6cdc038c make CountVectorizer able to output binary occurrence info 2012-03-03 19:53:21 +01:00
Olivier Grisel 38d4332293 factorize feature names array 2012-03-03 19:19:33 +01:00
Olivier Grisel a510d17a05 Flatten the feature extraction API 2012-03-03 17:20:32 +01:00
Andreas Mueller aaa6611614 COSMIT pep8 2012-02-17 16:49:48 +01:00
Robert Layton 64662c395e Test now works, testing both the Word and Char analyzers 2012-02-16 07:35:42 +11:00
Robert Layton d961bc2f35 Added a test (that doesn't work yet)
unicode_error renamed to decode_error
2012-02-15 21:41:16 +11:00
Alexandre Gramfort ad8e4912cb TST: use assert_true instead of assert + remove some relative imports 2012-02-11 15:43:03 +01:00
Lars Buitinck 654a39cf15 ENH more generic dict-like test in CountVectorizer
Includes test.
2012-02-07 17:11:03 +01:00
Lars Buitinck 5e92beb694 ENH sublinear tf scaling in TfidfTransformer 2012-02-04 16:51:40 +01:00
Lars Buitinck b2239332f5 COSMIT fix ugly import, left over from LinearSVC refactoring 2012-01-17 09:22:58 +01:00
Lars Buitinck 9b0fbab0d1 ENH merge dense/sparse LinearSVC, part 3: deprecate sparse.LinearSVC 2012-01-16 18:27:14 +01:00
Andreas Mueller 68a8b8b46d ENH renamed best_estimator and best_score in examples and tests. 2012-01-05 23:35:33 +01:00
Olivier Grisel ee4c2043ad FIX: incomplete test for inverse_transform in text feature extraction 2012-01-02 10:12:32 +01:00
Lars Buitinck f116314f5c Revert "BUG Disallow negative tf-idf weight"
This reverts commit 617d731918.

Breaks other tests; let's live with the negative tf-idf weights for now.
2011-12-24 22:03:27 +01:00
Xinfan Meng 617d731918 BUG Disallow negative tf-idf weight
Add the same smoothing count to n_samples to avoid negative weight.
2011-12-24 21:40:15 +01:00
Andreas Mueller d0854d5a07 COSMIT pep8 2011-12-15 17:08:30 +01:00
Gael varoquaux 8118f6efde BUG: vectorizer.inverse_transform on arrays
Matrices and arrays have different indexing rules: matrices are always 2D
objects, thus slicing a matrix returns a 2D object.
2011-11-07 09:12:33 +01:00
Olivier Grisel cc678ade87 typo: s/accurracy/accuracy/g 2011-09-21 18:44:26 +02:00
Fabian Pedregosa ddf4b72109 Move project directory from scikits.learn to sklearn 2011-09-02 12:06:57 +02:00
Fabian Pedregosa 68f27e3790 Revert "Move project directory from scikits.learn to sklearn"
This reverts commit fd0d3b879d.
2011-09-02 12:03:18 +02:00
Fabian Pedregosa fd0d3b879d Move project directory from scikits.learn to sklearn 2011-09-02 11:38:24 +02:00