Commit Graph

287 Commits

Author SHA1 Message Date
Dimitri Papadopoulos Orfanos ee5a1b69d1
DOC, MNT Typos found by codespell (#22906) 2022-03-20 19:16:39 +01:00
Adrin Jalali 7dc97a378e
API get_scorer returns a copy and introduce get_scorer_names (#22866) 2022-03-20 07:30:21 +11:00
Alexandre Gramfort 1a1c73da4a
DOC: Fix latex \max and not max in model selection (#22858) 2022-03-16 10:28:10 +01:00
Gael Varoquaux 3f7f71417b
DOC: put more emphasis on r2_score (#22491)
Co-authored-by: Guillaume Lemaitre <g.lemaitre58@gmail.com>
2022-02-15 19:09:42 +01:00
hmasdev 77bc7f921c
DOC Fix expired links to some references (#22373)
Co-authored-by: Thomas J. Fan <thomasjpfan@gmail.com>
Co-authored-by: hmasdev <hmasdev@gmail.com>
2022-02-05 10:58:30 -05:00
Jake Cowton 08e0216784
DOC Updated documentation to show jaccard score usage for image comparison (#21978)
* FIX Updated jaccard score documentation

Docs now show 2D jaccard score usage for image comparison

* Updated jaccard_score docs to use micro avg in 2d comparison
2022-01-21 18:51:08 +01:00
Sylvain Marié cb98be0239
ENH add force_finite to control the behaviour of constant target in explained variance and R2 (#17266)
* Improved R2 score implementation and documentation by making it more clear that the default behaviour contains a fix to transform `NaN` and `-Inf` scores obtained when `y_true` is constant, to 1.0 and 0.0 respectively. Fixes #16857

Co-authored-by: Sylvain MARIE <sylvain.marie@se.com>
Co-authored-by: Julien Jerphanion <git@jjerphan.xyz>
Co-authored-by: Guillaume Lemaitre <g.lemaitre58@gmail.com>
Co-authored-by: Christian Lorentzen <lorentzen.ch@gmail.com>
2022-01-05 14:16:14 +01:00
puhuk 337e0d234b
DOC Use :doi: and :arxiv: directives for references (#21099) 2021-10-20 13:53:25 -04:00
almeidayoel 2b7564c155
DOC fix typo in DET curve description (#21089) 2021-09-20 23:01:29 +02:00
Dimitri Papadopoulos Orfanos f71c031314
DOC Typos found by codespell (#21069) 2021-09-17 19:04:54 +02:00
Christian Lorentzen 9061ff9e58
FEA add d2_tweedie_score (#17036) 2021-09-04 23:17:03 +02:00
Guillaume Lemaitre d4da690822
API add from_estimator and from_preditions to PrecisionRecallDisplay (#20552)
Co-authored-by: Roman Yurchak <rth.yurchak@gmail.com>
2021-08-31 10:51:32 +02:00
Guillaume Lemaitre 4b0d291fb3
DOC fix hyperlink for permutation test example (#20697)
Co-authored-by: Thomas J. Fan <thomasjpfan@gmail.com>
2021-08-07 16:39:46 -04:00
John Paton cea784e75e
DOC Update broken Davis2006 reference link in Model Evaluation User Guide (#20339) 2021-06-24 13:44:40 +02:00
Jérémie du Boisberranger ef71c8597e
MNT Clean deprecations for 1.0 | trees (#19336) 2021-06-15 18:18:47 +02:00
Tom Dupré la Tour f6e6ad2d9e
MNT clean futurewarning for 1.0 | _deprecate_positional_args (#20002)
Co-authored-by: Olivier Grisel <olivier.grisel@ensta.org>
Co-authored-by: Thomas J. Fan <thomasjpfan@gmail.com>
2021-05-14 11:30:27 -04:00
xavier dupré 6a6217f15f
ENH Add mean_pinball_loss metric for quantile regression (#19415)
Co-authored-by: Olivier Grisel <olivier.grisel@ensta.org>
Co-authored-by: Christian Lorentzen <lorentzen.ch@gmail.com>
2021-02-18 19:43:40 +01:00
Guillaume Lemaitre 8c6a045e46
ENH/DEP add class method and deprecate plot function for confusion matrix (#18543)
Co-authored-by: Thomas J. Fan <thomasjpfan@gmail.com>
Co-authored-by: Adrin Jalali <adrin.jalali@gmail.com>
2021-01-22 19:57:41 +01:00
RamyaNP d304331b45
DOC fix multiclass AUC formulas in user guide (#18559) 2020-12-16 17:35:19 +01:00
ufmayer 662cc647d9
FEA Add Rand Index and pair confusion matrix (#17412)
Co-authored-by: Chiara Marmo <cmarmo@users.noreply.github.com>
2020-10-28 14:28:11 +01:00
Geoffrey Bolmier 5654da026b
FEA Top k accuracy metric (#16625)
Co-authored-by: Nicolas Hug <contact@nicolas-hug.com>
Co-authored-by: Jeremiah Johnson <jwjohnson314@gmail.com>
Co-authored-by: Roman Yurchak <rth.yurchak@gmail.com>
2020-10-16 16:51:41 +02:00
Sam 858fa806ec
DOC Fix parameter order in model_evaluation.rst (#18602) 2020-10-12 13:19:52 +02:00
Guillaume Lemaitre 80c0a29382
DOC improve the ROC-AUC docstring (#18110)
Co-authored-by: Thomas J. Fan <thomasjpfan@gmail.com>
2020-09-01 10:49:20 +02:00
Guillaume Lemaitre e030010c6c
ENH Adds plot_det_curve and associated display (#18176)
Co-authored-by: Christian Lorentzen <lorentzen.ch@gmail.com>
Co-authored-by: Thomas J. Fan <thomasjpfan@gmail.com>
2020-08-28 22:36:52 -04:00
Juan Carlos Alfaro Jiménez 395d6c171f
DOC/FIX Remove toctree from autosummary directives outside of the API (#17358) 2020-08-19 14:35:46 +02:00
Guillaume Lemaitre bf4714f401
ENH follow-up style improvements of DET curves #10591 (#18169)
* follow-up on #10591 

* DOC improvements

* TST add additional test for pos_label

Co-authored-by: Christian Lorentzen <lorentzen.ch@gmail.com>
2020-08-19 12:39:56 +02:00
Christian Lorentzen e0abd262ea
DOC improve model evaluation a bit (#18166) 2020-08-17 07:55:57 -04:00
Daniel Mohns 41d648ef88
[MRG] Add Detection Error Tradeoff (DET) curve classification metrics (#10591)
* Initial add DET curve to classification metrics

* Add DET to exports

* Fix DET-curve doctest errors

- Sample snippet in  model_evaluation documentation was outdated.

* Clarify wording in DET-curve computation

- Align to the wording of ranking module to make it consistent.
- Add correct describtion of input and outputs.
- Update and fix non-existent links

* Beautify DET curve documentation source

- Limit line length to 80 characters.

* Expand DET curve documentation

- Add an example plot to show difference between ROC and DET curves.
- Expand Usage Note section with background information and properties
of DET curves.

* Update DET-curve documentation

- Fix typos and some grammar improvements.
- Use named references to avoid potential conflicts with other sections.
- Remove unneeded references and improved existing ones by using e.g.
using versioned links.

* Select relevant DET points using slice object

* Remove some dubiety from DET curve doc-string

* Add DET curve contributors

* Add tests for DET curves

* Streamline DET test by using parametrization

* Increase verbosity of DET curve error handling

- Explicitly sanity check input before computing a DET curve.
- Add test for perfect scores.
- Adapt indentation style to match the test module.

* Add reference for DET curves in invariance test

* Add automated invariance checks for DET curves

* Resolve merge artifacts

* Make doctest happy

* Fix whitespaces for doctest

* Revert unintended whitespace changes

* Revert unintended white space changes #2

* Fix typos and grammar

* Fix white space in doc

* Streamline test code

* Remove rebase artifacts

* Fix PR link in doc

* Fix test_ranking

* Fix rebase errors

* Fix import

* Bring back newlines

- Swallowed by copy/paste

* Remove uncited ref link

* Remove matplotlib deprecation warning

* Bring back hidden reference

* Add motivation to DET example

* Fix lint

* Add citation

* Use modern matplotlib API

Co-authored-by: Jeremy Karnowski <jeremy.karnowski@gmail.com>
Co-authored-by: Julien Cornebise <julien@cornebise.com>
Co-authored-by: Daniel Mohns <daniel.mohns@zenguard.org>
2020-08-16 11:34:37 +02:00
Lucy Liu 854f649307
DOC Expand Brier score, fix docstring (#18051)
* fix brier

* fix brier

* add ref

* add ref for lint

* Add link to PDF for calibration book chapter.

* Fix broken repeated ref by using qualified identifier

* Fix indentation

Co-authored-by: Olivier Grisel <olivier.grisel@ensta.org>
2020-08-13 19:25:01 -04:00
Thomas J. Fan 9acfaab966
ENH Adds support for multimetric callable return a dictionary (#15126) 2020-07-16 17:55:40 +02:00
Ashutosh Hathidara 0ea3244061
Added mean_absolute_percentage_error in metrics fixes #10708 (#15007)
Co-authored-by: mohamed-ali <m.ali.jamaoui@gmail.com>
Co-authored-by: Alexandre Gramfort <alexandre.gramfort@m4x.org>
Co-authored-by: Olivier Grisel <olivier.grisel@ensta.org>
Co-authored-by: Joel Nothman <joel.nothman@gmail.com>
Co-authored-by: Roman Yurchak <rth.yurchak@pm.me>
2020-07-04 13:24:20 +02:00
Nicolas Hug 04b3283a1e
DOC added links to ndcg_score in UG (#17637) 2020-06-19 15:38:52 -04:00
James Hoctor 211ab3e8a3
DOC Avoid atypical usage of cross_validate (#17600) 2020-06-15 22:38:27 -04:00
Shiki-H 8868ec775e
DOC Add formula for binary balanced accuracy in UG (#16604) 2020-03-01 08:50:29 -05:00
Jon Haitz Legarreta Gorroño 14e597c700
DOC Fix syntax in `model_evaluation` UG (#16410) 2020-02-10 08:49:46 -05:00
Oliver Urs Lenz 2e90b89776 DOC clarify doc-string of roc_auc_score and add references (#15293) 2019-12-19 14:44:44 +01:00
Brian Wignall c4733f4895 MNT Fix some easy-to-make typos (#15720) 2019-11-26 06:31:40 -06:00
Guillaume Lemaitre 080d0e5595 ENH add normalize parameter to confusion_matrix (#15625) 2019-11-15 04:44:23 -06:00
Thomas J Fan e650a207ef ENH Adds plot_confusion matrix (#15083) 2019-11-14 14:43:54 +01:00
Thomas J Fan 968252dfb4 FEA Adds plot_precision_recall_curve (#14936) 2019-11-10 20:54:35 -06:00
Peter Marko 6d38b5fcbc DOC multiclass balanced_accuracy_score (#15302) 2019-10-19 19:43:25 -04:00
Nicolas Hug 3c134503fe DOC change model evaluation section title (#15157) 2019-10-14 15:37:13 +02:00
stefan-matcovici d369a5f294 API Replace scorer brier_score_loss with neg_brier_score (#14898) 2019-09-19 09:37:33 +08:00
Roman Yurchak 8e81490d83 CLN Rename p to power parameter in mean_tweedie_deviance (#14852) 2019-09-09 13:45:36 -04:00
Thomas J Fan 96bfae69ce ENH Adds roc weighted scorers to SCORERS (#14417) 2019-09-04 15:41:29 -04:00
Kanika Sabharwal 40c7978a64 use return_X_y=True for load_iris dataset (#14777) 2019-08-24 17:54:16 -04:00
jeromedockes be27d909e0 FEA Add Normalized Discounted Cumulative Gain (#9951) 2019-08-13 13:02:04 +10:00
Urvang Patel 6425a8f7d1 ENH Add RMSE (root-mean-square error) metric and scorer (#13467) 2019-08-07 23:33:43 +03:00
Christian Lorentzen 89da7f71a6 ENH Add Poisson, Gamma and Tweedie deviances to regression metrics (#14263)
* ENH add new metric Tweedie deviance

* More improvements

* A few more fixes

* Fix doctest

* Review comments

* Add common metric tests

* Add what's new entry

* Fix symmetry check in metrics common tests

* Fix test order determinism

* Rename metric to mean_tweedie_deviance

* Address review comments

* Fix test_score_objects.py tests

* Add Poisson and Gamma deviances

* Fix doc link

* Fix typo on what's new

* Fix rst rendering
2019-07-19 17:45:00 +02:00
Thomas J Fan dc9955b5d4 [MRG] Adds multiclass ROC AUC (#12789) 2019-07-17 16:45:27 -04:00