Commit Graph

71 Commits

Author SHA1 Message Date
Thomas J. Fan 82df48934e
MNT Applies black formatting to most of the code base (#18948) 2021-06-17 14:21:09 -04:00
Avi Gupta ca9618c0e2
MNT move PolynomialFeatures from _data.py to _polynomial.py (#19611)
Co-authored-by: Roman Yurchak <rth.yurchak@gmail.com>
2021-03-18 14:58:51 +01:00
Christian Lorentzen 27f1c737f2
FEA Add SplineTransformer (#18368) 2021-01-24 10:53:27 +01:00
Thomas J Fan 15d5ef04df MNT Make modules private in preprocessing (#15323) 2019-10-22 11:37:05 +08:00
Guillaume Lemaitre 6525a39dd6 MNT Remove Imputer in preprocessing (#13796) 2019-05-08 22:24:32 +08:00
Andreas Mueller 0f94f2962b
MNT simple deprecations and removals for 0.21 (#12238)
Part of #11992.
These were all the things that seemed pretty straight-forward. It's actually a bit bulky but should still be easy to review, hopefully.
2018-10-11 14:56:37 -04:00
Joel Nothman bb719e188c Move _transform_selected helper to base.py 2018-07-10 09:52:25 +10:00
Joel Nothman 40d1f00c82 Merge branch 'master' into discrete 2018-07-10 09:46:03 +10:00
Tom Dupré la Tour 5a61af94e2 [MRG+2] Implement two non-uniform strategies for KBinsDiscretizer (discrete branch) (#11272) 2018-07-10 09:29:56 +10:00
Joris Van den Bossche 007aa710bd FEA Refactor CategoricalEncoder into OneHotEncoder and OrdinalEncoder (#10523)
Deprecated some OneHotEncoder behaviour
2018-06-21 19:27:41 +10:00
Joel Nothman f737fe6af3
Merge branch 'master' into discrete 2018-05-30 12:56:45 +10:00
Joel Nothman b43fce5a49 MNT Add sklearn.compose and move TransformedTargetRegressor to it (#10719) 2018-03-16 21:27:03 +08:00
Guillaume Lemaitre 4f710cdd08 FEA TransformedTargetRegressor (#9041)
Add a new meta-regressor which transforms y for training.
2017-12-14 09:31:03 +11:00
Hanmin Qin ef57c34919
Merge branch 'master' into discrete 2017-12-06 14:21:49 +08:00
Eric Chang 62e9bb8def Feature: Implement PowerTransformer (#10210) 2017-12-06 08:29:10 +11:00
Tom Dupré la Tour 0a91bce8ee Merge branch 'master' into discrete
Conflicts:
	doc/modules/preprocessing.rst
2017-11-23 13:53:24 +01:00
Joris Van den Bossche a2ebb8cfd2 ENH: new CategoricalEncoder class (#9151) 2017-11-21 20:03:41 +11:00
hlin117 7ef342ee89 ENH add fixed-width discretizer 2017-07-12 18:20:14 +10:00
Guillaume Lemaitre 26a1027a83 [MRG+1] QuantileTransformer (#8363)
* resurrect quantile scaler

* move the code in the pre-processing module

* first draft

* Add tests.

* Fix bug in QuantileNormalizer.

* Add quantile_normalizer.

* Implement pickling

* create a specific function for dense transform

* Create a fit function for the dense case

* Create a toy examples

* First draft with sparse matrices

* remove useless functions and non-negative sparse compatibility

* fix slice call

* Fix tests of QuantileNormalizer.

* Fix estimator compatibility

* List of functions became tuple of functions
* Check X consistency at transform and inverse transform time

* fix doc

* Add negative ValueError tests for QuantileNormalizer.

* Fix cosmetics

* Fix compatibility numpy <= 1.8

* Add n_features tests and correct ValueError.

* PEP8

* fix fill_value for early scipy compatibility

* simplify sampling

* Fix tests.

* removing last pring

* Change choice for permutation

* cosmetics

* fix remove remaining choice

* DOC

* Fix inconsistencies

* pep8

* Add checker for init parameters.

* hack bounds and make a test

* FIX/TST bounds are provided by the fitting and not X at transform

* PEP8

* FIX/TST axis should be <= 1

* PEP8

* ENH Add parameter ignore_implicit_zeros

* ENH match output distribution

* ENH clip the data to avoid infinity due to output PDF

* FIX ENH restraint to uniform and norm

* [MRG] ENH Add example comparing the distribution of all scaling preprocessor (#2)

* ENH Add example comparing the distribution of all scaling preprocessor

* Remove Jupyter notebook convert

* FIX/ENH Select feat before not after; Plot interquantile data range for all

* Add heatmap legend

* Remove comment maybe?

* Move doc from robust_scaling to plot_all_scaling; Need to update doc

* Update the doc

* Better aesthetics; Better spacing and plot colormap only at end

* Shameless author re-ordering ;P

* Use env python for she-bang

* TST Validity of output_pdf

* EXA Use OrderedDict; Make it easier to add more transformations

* FIX PEP8 and replace scipy.stats by str in example

* FIX remove useless import

* COSMET change variable names

* FIX change output_pdf occurence to output_distribution

* FIX partial fixies from comments

* COMIT change class name and code structure

* COSMIT change direction to inverse

* FIX factorize transform in _transform_col

* PEP8

* FIX change the magic 10

* FIX add interp1d to fixes

* FIX/TST allow negative entries when ignore_implicit_zeros is True

* FIX use np.interp instead of sp.interpolate.interp1d

* FIX/TST fix tests

* DOC start checking doc

* TST add test to check the behaviour of interp numpy

* TST/EHN Add the possibility to add noise to compute quantile

* FIX factorize quantile computation

* FIX fixes issues

* PEP8

* FIX/DOC correct doc

* TST/DOC improve doc and add random state

* EXA add examples to illustrate the use of smoothing_noise

* FIX/DOC fix some grammar

* DOC fix example

* DOC/EXA make plot titles more succint

* EXA improve explanation

* EXA improve the docstring

* DOC add a bit more documentation

* FIX advance review

* TST add subsampling test

* DOC/TST better example for the docstring

* DOC add ellipsis to docstring

* FIX address olivier comments

* FIX remove random_state in sparse.rand

* FIX spelling doc

* FIX cite example in user guide and docstring

* FIX olivier comments

* EHN improve the example comparing all the pre-processing methods

* FIX/DOC remove title

* FIX change the scaling of the figure

* FIX plotting layout

* FIX ratio w/h

* Reorder and reword the plot_all_scaling example

* Fix aspect ratio and better explanations in the plot_all_scaling.py example

* Fix broken link and remove useless sentence

* FIX fix couples of spelling

* FIX comments joel

* FIX/DOC address documentation comments

* FIX address comments joel

* FIX inline sparse and dense transform

* PEP8

* TST/DOC temporary skipping test

* FIX raise an error if n_quantiles > subsample

* FIX wording in smoothing_noise example

* EXA Denis comments

* FIX rephrasing

* FIX make smoothing_noise to be a boolearn and change doc

* FIX address comments

* FIX verbose the doc slightly more

* PEP8/DOC

* ENH: 2-ways interpolation to avoid smoothing_noise

Simplifies also the code, examples, and documentation
2017-06-10 01:15:46 +02:00
Lars Buitinck b09afb08be DOC/MAINT final touches to FunctionTransformer
* copyedit doc
* give the module an underscore (we should do this to all private modules...)
* use public import path in test
* change all logs to log1p to prevent warning in test and because it's
  genuinely useful for frequency data
* what's new
2015-08-03 22:12:19 +02:00
Andreas Mueller 9d14f7352e ENH: Renames CallableTransformer -> FunctionTransformer.
Makes `pass_y` an argument to FunctionTransformer to indicate that the
labels should be passed to the wrapped function.
2015-08-03 11:45:16 -04:00
Joe Jevnik cb0916c440 ENH: Adds CallableTransformer
CallableTransformer allows a user to convert a standard python callable
into a transformer for use in a Pipeline.
2015-08-03 11:45:16 -04:00
Thomas Unterthiner 26fbfe6f2e ENH add minmax_scale 2015-07-01 23:27:35 +02:00
Thomas Unterthiner ab734b7a39 ENH add MaxAbsScaler 2015-06-11 16:08:17 +02:00
Thomas Unterthiner 29e8377e19 Export robust_scale and RobustScaler 2015-05-16 00:08:37 +02:00
Lars Buitinck c484a4a844 MAINT remove deprecated code from preprocessing 2014-07-22 15:57:18 +02:00
Joel Nothman 18c399e20a MAINT deprecate sequences of sequences support
* add warnings
 * provide alternative binarizer, sklearn.preprocessing.MultiLabelBinarizer
 * fix documentation
2014-06-05 11:20:35 +02:00
Lars Buitinck 4c6e0263b4 MAINT final occurrence of "Scaler" 2014-03-12 14:11:32 +01:00
Lars Buitinck 0abe21eaac MAINT remove some deprecated stuff 2014-03-12 13:33:42 +01:00
Joel Nothman dbc26ce996 COSMIT remove unused imports and variables 2014-02-03 19:43:56 +11:00
Jake Vanderplas f372e126c0 fix ordering & docs of PolynomialFeatures 2013-11-15 08:10:15 -08:00
Jake Vanderplas 568c43d6f3 ENH: add PolynomialFeatures preprocessor 2013-11-11 17:18:16 -08:00
Gael Varoquaux 89011e369a MISC: deprecate balance_weights (it's internal) 2013-07-29 03:06:58 +02:00
Nelle Varoquaux e3a764db5e FIX backward compatibility was broken 2013-07-29 03:06:58 +02:00
Nicolas Trésegnie f713996882 pyflakes and pep8 2013-07-26 17:08:59 +02:00
Nicolas Trésegnie 9cb320dd6d Imp move OneHotEncoder to preprocessing/data.py 2013-07-26 17:08:59 +02:00
Nicolas Trésegnie 15984d9a55 Del unused imports in preprocessing + pep8 2013-07-26 17:08:58 +02:00
Nicolas Trésegnie b8201b452f Imp splitting of test_preprocessing.py 2013-07-26 17:08:58 +02:00
Nicolas Trésegnie ec6057a384 Imp splitting of preprocessing.py 2013-07-26 17:08:58 +02:00
Mathieu Blondel c9d27f3dc0 Move preprocessing.py to sklearn/. 2012-01-21 05:39:34 +09:00
Mathieu Blondel ebb42e78e6 preprocessing/__init__.py -> preprocessing/preprocessing.py
It's hard to find the right file when you have several __init__.py
files opened.
2012-01-21 05:29:42 +09:00
Olivier Grisel f09db8ddff more pep8 2012-01-04 00:47:30 +01:00
Andy ed7de9f80f FIX: Notes instead of Note in preprocessing init 2011-12-29 17:02:42 +01:00
Olivier Grisel 8a8c6ebed3 optim: avoid useless memory copy when input is non CSR 2011-12-28 10:43:16 +01:00
Olivier Grisel 671f304ac6 More checks when transforming sparse matrices with centering scalers + typo 2011-12-27 10:05:33 +01:00
Olivier Grisel 2e0857aeac wording 2011-12-25 00:28:53 +01:00
Olivier Grisel f85e7be8c5 fix scaling, more tests and docstrings 2011-12-24 23:36:38 +01:00
Olivier Grisel 1fdbbfb44b WIP: feature scaling for CSR input (lacks some tests) 2011-12-24 12:37:09 +01:00
Olivier Grisel 57a90f8dcf Merge branch 'master' into sparse-scaler 2011-12-23 22:53:31 +01:00
Andreas Mueller 3a6e490e05 COSMIT pep8 2011-12-23 19:12:52 +01:00