Commit Graph

265 Commits

Author SHA1 Message Date
Guillaume Lemaitre 80c0a29382
DOC improve the ROC-AUC docstring (#18110)
Co-authored-by: Thomas J. Fan <thomasjpfan@gmail.com>
2020-09-01 10:49:20 +02:00
Guillaume Lemaitre e030010c6c
ENH Adds plot_det_curve and associated display (#18176)
Co-authored-by: Christian Lorentzen <lorentzen.ch@gmail.com>
Co-authored-by: Thomas J. Fan <thomasjpfan@gmail.com>
2020-08-28 22:36:52 -04:00
Juan Carlos Alfaro Jiménez 395d6c171f
DOC/FIX Remove toctree from autosummary directives outside of the API (#17358) 2020-08-19 14:35:46 +02:00
Guillaume Lemaitre bf4714f401
ENH follow-up style improvements of DET curves #10591 (#18169)
* follow-up on #10591 

* DOC improvements

* TST add additional test for pos_label

Co-authored-by: Christian Lorentzen <lorentzen.ch@gmail.com>
2020-08-19 12:39:56 +02:00
Christian Lorentzen e0abd262ea
DOC improve model evaluation a bit (#18166) 2020-08-17 07:55:57 -04:00
Daniel Mohns 41d648ef88
[MRG] Add Detection Error Tradeoff (DET) curve classification metrics (#10591)
* Initial add DET curve to classification metrics

* Add DET to exports

* Fix DET-curve doctest errors

- Sample snippet in  model_evaluation documentation was outdated.

* Clarify wording in DET-curve computation

- Align to the wording of ranking module to make it consistent.
- Add correct describtion of input and outputs.
- Update and fix non-existent links

* Beautify DET curve documentation source

- Limit line length to 80 characters.

* Expand DET curve documentation

- Add an example plot to show difference between ROC and DET curves.
- Expand Usage Note section with background information and properties
of DET curves.

* Update DET-curve documentation

- Fix typos and some grammar improvements.
- Use named references to avoid potential conflicts with other sections.
- Remove unneeded references and improved existing ones by using e.g.
using versioned links.

* Select relevant DET points using slice object

* Remove some dubiety from DET curve doc-string

* Add DET curve contributors

* Add tests for DET curves

* Streamline DET test by using parametrization

* Increase verbosity of DET curve error handling

- Explicitly sanity check input before computing a DET curve.
- Add test for perfect scores.
- Adapt indentation style to match the test module.

* Add reference for DET curves in invariance test

* Add automated invariance checks for DET curves

* Resolve merge artifacts

* Make doctest happy

* Fix whitespaces for doctest

* Revert unintended whitespace changes

* Revert unintended white space changes #2

* Fix typos and grammar

* Fix white space in doc

* Streamline test code

* Remove rebase artifacts

* Fix PR link in doc

* Fix test_ranking

* Fix rebase errors

* Fix import

* Bring back newlines

- Swallowed by copy/paste

* Remove uncited ref link

* Remove matplotlib deprecation warning

* Bring back hidden reference

* Add motivation to DET example

* Fix lint

* Add citation

* Use modern matplotlib API

Co-authored-by: Jeremy Karnowski <jeremy.karnowski@gmail.com>
Co-authored-by: Julien Cornebise <julien@cornebise.com>
Co-authored-by: Daniel Mohns <daniel.mohns@zenguard.org>
2020-08-16 11:34:37 +02:00
Lucy Liu 854f649307
DOC Expand Brier score, fix docstring (#18051)
* fix brier

* fix brier

* add ref

* add ref for lint

* Add link to PDF for calibration book chapter.

* Fix broken repeated ref by using qualified identifier

* Fix indentation

Co-authored-by: Olivier Grisel <olivier.grisel@ensta.org>
2020-08-13 19:25:01 -04:00
Thomas J. Fan 9acfaab966
ENH Adds support for multimetric callable return a dictionary (#15126) 2020-07-16 17:55:40 +02:00
Ashutosh Hathidara 0ea3244061
Added mean_absolute_percentage_error in metrics fixes #10708 (#15007)
Co-authored-by: mohamed-ali <m.ali.jamaoui@gmail.com>
Co-authored-by: Alexandre Gramfort <alexandre.gramfort@m4x.org>
Co-authored-by: Olivier Grisel <olivier.grisel@ensta.org>
Co-authored-by: Joel Nothman <joel.nothman@gmail.com>
Co-authored-by: Roman Yurchak <rth.yurchak@pm.me>
2020-07-04 13:24:20 +02:00
Nicolas Hug 04b3283a1e
DOC added links to ndcg_score in UG (#17637) 2020-06-19 15:38:52 -04:00
James Hoctor 211ab3e8a3
DOC Avoid atypical usage of cross_validate (#17600) 2020-06-15 22:38:27 -04:00
Shiki-H 8868ec775e
DOC Add formula for binary balanced accuracy in UG (#16604) 2020-03-01 08:50:29 -05:00
Jon Haitz Legarreta Gorroño 14e597c700
DOC Fix syntax in `model_evaluation` UG (#16410) 2020-02-10 08:49:46 -05:00
Oliver Urs Lenz 2e90b89776 DOC clarify doc-string of roc_auc_score and add references (#15293) 2019-12-19 14:44:44 +01:00
Brian Wignall c4733f4895 MNT Fix some easy-to-make typos (#15720) 2019-11-26 06:31:40 -06:00
Guillaume Lemaitre 080d0e5595 ENH add normalize parameter to confusion_matrix (#15625) 2019-11-15 04:44:23 -06:00
Thomas J Fan e650a207ef ENH Adds plot_confusion matrix (#15083) 2019-11-14 14:43:54 +01:00
Thomas J Fan 968252dfb4 FEA Adds plot_precision_recall_curve (#14936) 2019-11-10 20:54:35 -06:00
Peter Marko 6d38b5fcbc DOC multiclass balanced_accuracy_score (#15302) 2019-10-19 19:43:25 -04:00
Nicolas Hug 3c134503fe DOC change model evaluation section title (#15157) 2019-10-14 15:37:13 +02:00
stefan-matcovici d369a5f294 API Replace scorer brier_score_loss with neg_brier_score (#14898) 2019-09-19 09:37:33 +08:00
Roman Yurchak 8e81490d83 CLN Rename p to power parameter in mean_tweedie_deviance (#14852) 2019-09-09 13:45:36 -04:00
Thomas J Fan 96bfae69ce ENH Adds roc weighted scorers to SCORERS (#14417) 2019-09-04 15:41:29 -04:00
Kanika Sabharwal 40c7978a64 use return_X_y=True for load_iris dataset (#14777) 2019-08-24 17:54:16 -04:00
jeromedockes be27d909e0 FEA Add Normalized Discounted Cumulative Gain (#9951) 2019-08-13 13:02:04 +10:00
Urvang Patel 6425a8f7d1 ENH Add RMSE (root-mean-square error) metric and scorer (#13467) 2019-08-07 23:33:43 +03:00
Christian Lorentzen 89da7f71a6 ENH Add Poisson, Gamma and Tweedie deviances to regression metrics (#14263)
* ENH add new metric Tweedie deviance

* More improvements

* A few more fixes

* Fix doctest

* Review comments

* Add common metric tests

* Add what's new entry

* Fix symmetry check in metrics common tests

* Fix test order determinism

* Rename metric to mean_tweedie_deviance

* Address review comments

* Fix test_score_objects.py tests

* Add Poisson and Gamma deviances

* Fix doc link

* Fix typo on what's new

* Fix rst rendering
2019-07-19 17:45:00 +02:00
Thomas J Fan dc9955b5d4 [MRG] Adds multiclass ROC AUC (#12789) 2019-07-17 16:45:27 -04:00
Thomas J Fan 2e7e06b78f [MRG] Doctest with print change only adjusts default options for doctest (#13991) 2019-06-01 10:53:45 +02:00
Brian G. Barkley 5e0d1a1f04 DOC Fix typo: omit comma (#13999) 2019-05-31 12:26:39 -04:00
Guillaume Lemaitre 9adba491a2 [MRG] DEP change the default of cv and n_splits (#13839) 2019-05-29 23:39:20 +10:00
Ming Li 2fd1a6725b DOC Improve documentation of R-squared in User Guide (#13867) 2019-05-18 21:33:37 +08:00
Guillaume Lemaitre 28480f4cb2 DEP change the default of gamma in SVM (#13801) 2019-05-07 16:12:49 +02:00
Joel Nothman 19c8af6d6a ENH/FIX Replace jaccard_similarity_score by sane jaccard_score (#13151) 2019-03-13 20:59:08 +08:00
Hanmin Qin f867ccc533 DOC balanced_accuracy supports multiclass 2019-03-12 22:48:55 +08:00
Hanmin Qin 5c8167a159 FIX Correct the definition of gamma=`scale` in svm (#13221) 2019-02-24 18:34:43 +11:00
Fibinse Xavier` 9928713ae5 DOC on parallelisation of custom scorer (#12813) 2019-01-15 18:48:45 +11:00
Nicolas Hug a50c03f975 [MRG] Add pprint for estimators - continued (#11705)
* add pprint for estimators

* strip color from length, add color option

* Minor cleaning, fixes, factoring and docs

* Added some basic tests

* Fixed line length issue

* fixed flake8 and added visual test for review

* Fixed test

* Fixed Python 2 issues (inspect.signature import)

* Trying to fix flake8 again

* Added special repr for functions

* Added some other visual tests

* Changed _format_function in to _format_callable

because callable() returns True also for class objects (which we want to
reprensent with their name as well anyway)

* Consistent output in Python 2 and 3

* WIP

* Now using the builtin pprint module

* pep8

* Added changed_only param

* Fixed printing when string would fit in less than line width

* Fixed printing of steps parameter

* Fixed changed_only param for short estimators

* fixed pep8

* Added some more description in docstring

* changed_only is now an option from set_config()

* Put _pprint.py into sklearn/utils, added tests

* Added doctest NORMALIZE_WHITESPACE where needed

* Fixed tests

* fix test-doc

* fixing test that passed before....

* Fixed tests

* Added test for changed_only and long lines

* typo

* Added authors names

* Added license file

* Added ellipsis based on number of elements in sequence + added increasinly aggressive repr strategies

* Updated whatsnew

* dont use increaingly aggressive strategy

* Fixed tests

* Removed LICENSE file and put license text in _pprint.py

* fixed test_base

* Sorted parameters dictionary for consistent output in 3.5

* Actually using OrderedDict...

* Addressed comments

* Added test for NaN changed parameter

* Update whatsnew

* Added example to set_config()

* Removed example

* Added example in gallery

* Spelling
2018-12-19 23:48:21 -05:00
adanhawth ff64eae031 DOC Fix LaTeX text{} block escaping of underscores in doc-modules-model_evaluation.rst (#12788) 2018-12-16 09:07:03 +08:00
Emmanuel Arias 72ba30060a ENH Use accuracy instead of micro-average in classification_report (#12758) 2018-12-13 21:00:40 +11:00
Hanmin Qin 7fe3413475 Revert "DOC Fix math typo in model_evaluation's explained_variance (#12747)"
This reverts commit bf2f648639.
2018-12-10 19:53:03 +08:00
Adrin Jalali bf2f648639 DOC Fix math typo in model_evaluation's explained_variance (#12747) 2018-12-10 10:21:44 +08:00
Joel Nothman 654c452291 DOC Revert "DOC Use defined notation for precision and recall (#12726)" (#12743) 2018-12-09 19:42:35 +08:00
Greg Gandenberger 1cb56ba882 DOC Use defined notation for precision and recall (#12726) 2018-12-06 09:10:23 +08:00
Shangwu Yao 65556317c9 FEA (0.21) multilabel confusion matrix (#11179) 2018-10-30 19:26:37 +08:00
Krishna Sangeeth 831c760ccf ENH (0.21) Add max_error to the existing set of metrics for regression (#12232) 2018-10-11 15:33:06 +08:00
TakingItCasual f4e7d2b19a Converting http to https (3)... (#12302) 2018-10-05 18:50:31 +02:00
Denis Kataev b020f62250 MNT Apply pep8 to docs code (#12275) 2018-10-05 22:51:42 +08:00
TakingItCasual 1e052e9da9 Converting http to https (2)... (#12292) 2018-10-04 23:06:14 +02:00
TakingItCasual 74b56dbc57 MNT Converting http to https (#12277) 2018-10-04 22:37:57 +08:00