Commit Graph

225 Commits

Author SHA1 Message Date
Brian Sun 4d68797e27
ENH Updating defaults for RandomForestRegressor and Classifier (#20803)
Co-authored-by: Guillaume Lemaitre <g.lemaitre58@gmail.com>
2021-11-30 00:29:46 +01:00
puhuk 337e0d234b
DOC Use :doi: and :arxiv: directives for references (#21099) 2021-10-20 13:53:25 -04:00
groceryheist 5073d692f0
DOC Clarify wording in ensemble.rst (#20094) 2021-05-14 15:40:16 -07:00
Christian Lorentzen 2bd3a4db52
ENH Consistent loss name for absolute error (#19733) 2021-05-10 22:10:21 +02:00
Nicolas Hug 309f135c32
MNT Remove HistGradientBoosting from experimental (#19799) 2021-04-02 16:40:20 +02:00
Christian Lorentzen b9d6db81ec
[MRG] ENH Consistent loss name for squared error (#19310) 2021-03-19 15:21:34 +01:00
Thomas J. Fan b4453f126f
ENH Add Categorical support for HistGradientBoosting (#18394)
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>
Co-authored-by: Olivier Grisel <olivier.grisel@ensta.org>
Co-authored-by: Olivier Grisel <olivier.grisel@gmail.com>
2020-11-16 23:10:12 +01:00
Juan Carlos Alfaro Jiménez 0efd08b0fa
DOC Specify shape with parentheses in ensemble user guide (#17888) 2020-07-11 13:29:24 +02:00
Lucy Liu 3ff398151f
DOC Replace boston dataset in ensemble.rst (#16876) 2020-05-19 08:51:36 +02:00
Nicolas Hug 863c1d683f
DOC Feature highlights for 0.23 (#17062) 2020-05-01 11:06:00 -04:00
Thomas J Fan 91e942759f
DOC Make release highlights the first gallery section (#16952) 2020-04-27 11:23:15 -04:00
Lucy Liu 94d8911310
DOC Fix typo in ensemble.rst (#16999) 2020-04-23 15:06:03 -04:00
Christian Lorentzen a93b15f19b
ENH Poisson loss for HistGradientBoostingRegressor (#16692) 2020-04-23 10:27:35 -04:00
Nicolas Hug 36ebf3e371
[MRG] Monotonic constraints for GBDT (#15582) 2020-03-24 20:27:00 +01:00
Nicolas Hug b6bbf58f0c
DOC Updated gradient boosting UG (#16178)
* Updated gradient boosting UG

* maybe fix sphinx warnings

* Addressed comments from Guillaume
2020-02-28 13:30:27 +01:00
Adrin Jalali e24998f19c
ENH Support sample weights in HGBT (#14696) 2020-02-24 13:45:50 -05:00
Johann Faouzi ee6b369b82
FEA Turn on early stopping in histogram GBDT by default (#14516) 2020-02-12 10:45:21 -05:00
Olivier Grisel 54c3a1fbe7
DOC More explicit warnings about impurity based feat. imp. (#16382) 2020-02-05 15:20:20 +01:00
Sunmi Yoon 4a187968ff
DOC Clarify that feature_importance_ are impurity based (#16237) 2020-02-01 13:18:11 +01:00
Nicolas Hug 42e17b3487 MNT Removed deprecated attributes and parameters -- ctnd (#15804) 2019-12-13 15:05:51 -05:00
Nicolas Hug 25e72d341e DOC fix early stopping doc in HGBT (#15623) 2019-11-14 10:52:05 +01:00
Nicolas Hug 60ce68c683 [MRG] DOC More details about parallelism (joblib, openMP, MKL...) (#15116) 2019-10-15 16:17:24 +02:00
Chiara Marmo 6bd8df099f DOC Fix warnings about references and links (#14976) 2019-09-23 11:49:08 -04:00
Chiara Marmo b64b0b5ab0 DOC Fix Title level inconsistency and orphaned page. (#15002) 2019-09-19 08:54:24 -04:00
Guillaume Lemaitre bab5926024 FEA: Stacking estimator for classification and regression (#11047) 2019-09-19 06:06:33 +10:00
Chiara Marmo f24a501e06 DOC Fix "Duplicate labels" & "Duplicate .. target" sphinx warn (#14931) 2019-09-11 13:51:58 +02:00
Nicolas Hug 5cf88db244 EHN Implement least absolute deviation loss in GBDTs (#13896) 2019-09-09 10:26:52 +02:00
Thomas J Fan 14f5302b70 DOC Link items explictly (#14817)
* DOC Link items explictly

* STY

* DOC Link another
2019-09-05 11:37:05 +02:00
Kanika Sabharwal 40c7978a64 use return_X_y=True for load_iris dataset (#14777) 2019-08-24 17:54:16 -04:00
Nicolas Hug 4b6273b874 ENH Native support for missing values in GBDTs (#13911)
* Added NaN support in mapper

* pep

* WIP

* some more

* WIP

* WIP

* bug fix

* basic tests

* some doc

* avoid some interactions

* Added tag

* better test

* decent test + fix bug

* add missing_fraction param to benchmark

* bin training and validation data separately

* shorter test

* Map missing values to first bin instead of last

* pep8

* Added whats new entry

* avoid some python interactions

* make predict_binned work

* fixed bug due to offset in bin_thresholds_ attribute

* more sensible binning strat

* typo

* user name

* Add small test

* convert to fortran array in tests

* some doc

* Added function test

* pep8

* Bin validation data using binmaper of training data

* Allocate first bin for missing entries based on the whole data, not just
training data.

* Addressed Thomas' comments

* Update sklearn/ensemble/_hist_gradient_boosting/tests/test_grower.py

* Addressed Guillaume's comments

* always allocate first bin for missing values

* reduce diff

* minor more consistent test

* typo

* WIP

* some doc

* reduce diff

* pep8

* minor

* remove prints

* towards nan only splits

* don't check right to left on split_on_nan

* cleaups

* format and comment

* Fixed bug + added more tests

* refactor tests

* put back n_threads to max value

* minor changes

* minor cleaning

* Add (failing) test that checks equivalence with min max imputation

* Decrease the likelihood of ties when training the trees

* More robust test

* Fix pytest parametrization

* Check bin thresholds in test

* Try to make the test even easier to see if the Linux 32bit build would pass in this case

* Don't check last non-missing bin if there's no nan

* Improve min-max imputation test

* FIX: _find_best_bin_to_split_right_to_left is still required even when left to right wants to split on nans

* comments

* remove split_on_nan

* ooops deleted useless files

* Got rid of individual checks in predictor code

+inf thresholds are only allowed in a split on nan situation.
Thresholds that are computed as +inf are capped to a very high constant
value

* can also remove special case in binning code

* minor typos + more consistent test

* renamed types -> common

* 1e300 -> almost inf

* added user guide section on missing values

* Addressed Olivier's comment + updated whatsnew

* addressed comments

* Fix doctest formatting

* Fix nan predictive doctest
2019-08-21 11:22:00 +02:00
Allen Akinkunle 01d8e70af0 MNT Use return_X_y=True with load_boston where appropriate (#14678) 2019-08-20 10:08:23 +08:00
Roman Yurchak 7eded0f647 MAINT DOC Fix CircleCI on master (#14586)
* [doc build] Fix underscore in text

* use n-features and \times instead of *

* [doc build] Another fix
2019-08-07 15:57:06 +02:00
Nicolas Hug 2df846281f DOC User guide section for histogram-based GBDTs (#14525)
* User guide for histogram based GBDTs

* Added backlinks to user guide in classes

* typos

* Roman's comments

* reduce diff

* Update doc/modules/ensemble.rst

* Addressed comments

* Added why it's faster explanation

* references at the end

* Update doc/modules/ensemble.rst

* Update doc/modules/ensemble.rst

* Update doc/modules/ensemble.rst

* added where code is parallel

* removed missing values section
2019-08-05 18:57:36 +02:00
abenbihi ab4b4ec5eb DOC add clarification on random forest default params (#13248) 2019-06-20 14:45:37 +02:00
Thomas J Fan 2e7e06b78f [MRG] Doctest with print change only adjusts default options for doctest (#13991) 2019-06-01 10:53:45 +02:00
Guillaume Lemaitre 9adba491a2 [MRG] DEP change the default of cv and n_splits (#13839) 2019-05-29 23:39:20 +10:00
Guillaume Lemaitre c28ef9ef2a DEP change the default of multi_class to 'auto' in logistic regression (#13807) 2019-05-22 09:57:15 -04:00
Guillaume Lemaitre 7896b21562 MNT change default of solver in LogisiticRegression (#13805) 2019-05-08 21:31:39 +08:00
Guillaume Lemaitre 28480f4cb2 DEP change the default of gamma in SVM (#13801) 2019-05-07 16:12:49 +02:00
Nicolas Hug 9f68c992ae [MRG+2] Faster Gradient Boosting Decision Trees with binned features (#12807) 2019-04-26 21:14:59 +02:00
Nicolas Hug 6b7dc9bc30 FEA Partial dependence plots (#12599) 2019-04-24 22:52:15 +10:00
Ramil Nugmanov d94e2a2f00 FEA VotingRegressor (#12513) 2019-04-10 21:27:17 +10:00
Thomas Fan 7bc20c0e50 DOC Minor changes to DOCS to address sphinx warnings (#12999) 2019-01-17 17:49:31 +08:00
Thomas Fan e4b4834d0a DOC: Fixes link (#12996) 2019-01-17 13:15:19 +11:00
Nicolas Hug d4c9e849ba DOC minor clarifications in ensemble.rst (#11810) 2018-10-17 21:03:24 +11:00
Denis Kataev b020f62250 MNT Apply pep8 to docs code (#12275) 2018-10-05 22:51:42 +08:00
Joel Nothman 79f5d147ea MNT Revert the deprecation of min_samples_leaf and min_weight_fraction_leaf (#11998) 2018-09-08 16:43:21 +02:00
Joel Nothman 7ed61a24fe ENH add multi_class='auto' for LogisticRegression, default from 0.22; default solver will be 'lbfgs' (#11905)
* Change default solver in LogisticRegression
* This is an API change, not a feature
* Decrease numerical precision in LogisticRegression doctest
* ENH add multi_class='auto' for LR, default from 0.22
* No warning when binary
2018-08-26 23:00:02 +03:00
Joel Nothman 2fe58e517c Deprecate min_samples_leaf and min_weight_fraction_leaf (#11870) 2018-08-23 08:30:47 +03:00
Dillon Niederhut 99f4fea18b DOC clarify feature importance calculation (#11521) 2018-08-14 11:55:39 +10:00