scikit-learn/examples/model_selection
Daniel Mohns 41d648ef88
[MRG] Add Detection Error Tradeoff (DET) curve classification metrics (#10591)
* Initial add DET curve to classification metrics

* Add DET to exports

* Fix DET-curve doctest errors

- Sample snippet in  model_evaluation documentation was outdated.

* Clarify wording in DET-curve computation

- Align to the wording of ranking module to make it consistent.
- Add correct describtion of input and outputs.
- Update and fix non-existent links

* Beautify DET curve documentation source

- Limit line length to 80 characters.

* Expand DET curve documentation

- Add an example plot to show difference between ROC and DET curves.
- Expand Usage Note section with background information and properties
of DET curves.

* Update DET-curve documentation

- Fix typos and some grammar improvements.
- Use named references to avoid potential conflicts with other sections.
- Remove unneeded references and improved existing ones by using e.g.
using versioned links.

* Select relevant DET points using slice object

* Remove some dubiety from DET curve doc-string

* Add DET curve contributors

* Add tests for DET curves

* Streamline DET test by using parametrization

* Increase verbosity of DET curve error handling

- Explicitly sanity check input before computing a DET curve.
- Add test for perfect scores.
- Adapt indentation style to match the test module.

* Add reference for DET curves in invariance test

* Add automated invariance checks for DET curves

* Resolve merge artifacts

* Make doctest happy

* Fix whitespaces for doctest

* Revert unintended whitespace changes

* Revert unintended white space changes #2

* Fix typos and grammar

* Fix white space in doc

* Streamline test code

* Remove rebase artifacts

* Fix PR link in doc

* Fix test_ranking

* Fix rebase errors

* Fix import

* Bring back newlines

- Swallowed by copy/paste

* Remove uncited ref link

* Remove matplotlib deprecation warning

* Bring back hidden reference

* Add motivation to DET example

* Fix lint

* Add citation

* Use modern matplotlib API

Co-authored-by: Jeremy Karnowski <jeremy.karnowski@gmail.com>
Co-authored-by: Julien Cornebise <julien@cornebise.com>
Co-authored-by: Daniel Mohns <daniel.mohns@zenguard.org>
2020-08-16 11:34:37 +02:00
..
README.txt DOC Modify documentation/examples for the new model_selection module 2015-10-29 16:49:23 +01:00
grid_search_text_feature_extraction.py EXA Remove redundant tol parameter for SGDClassifier (#14556) 2019-08-02 14:04:10 -04:00
plot_confusion_matrix.py ENH Adds plot_confusion matrix (#15083) 2019-11-14 14:43:54 +01:00
plot_cv_indices.py DOC simpler block delimitation in sphinx-gallery examples (#17068) 2020-06-08 23:23:14 -04:00
plot_cv_predict.py DOC exchanged boston for diabetes dataset in plot_cv_predict (#16312) 2020-01-30 13:02:06 -05:00
plot_det.py [MRG] Add Detection Error Tradeoff (DET) curve classification metrics (#10591) 2020-08-16 11:34:37 +02:00
plot_grid_search_digits.py DOC shorten links in examples/* modules (#17636) 2020-06-20 17:43:14 +02:00
plot_grid_search_refit_callable.py Avoid convergence warning in plot_grid_search_refit_callable (#14143) 2019-07-18 13:30:20 -04:00
plot_learning_curve.py DOC fix indentation in cv parameter description (#17161) 2020-05-08 16:03:43 -04:00
plot_multi_metric_evaluation.py DOC simpler block delimitation in sphinx-gallery examples (#17068) 2020-06-08 23:23:14 -04:00
plot_nested_cross_validation_iris.py [MRG] DEP change default and deprecate iid in SearchCV (#13834) 2019-05-09 14:26:05 +02:00
plot_precision_recall.py DOC simpler block delimitation in sphinx-gallery examples (#17068) 2020-06-08 23:23:14 -04:00
plot_randomized_search.py DOC correct estimator name in example (#17239) 2020-05-16 18:07:33 -04:00
plot_roc.py DOC simpler block delimitation in sphinx-gallery examples (#17068) 2020-06-08 23:23:14 -04:00
plot_roc_crossval.py DOC Fix deprecation warning in plot_roc_crossval (#17155) 2020-05-07 20:01:04 -04:00
plot_train_error_vs_test_error.py DOC Fix warnings in examples (#12654) 2019-01-17 21:41:13 +11:00
plot_underfitting_overfitting.py [MRG + 1] 18 more examples with matplotlib 2.0 updates (#8983) 2017-06-07 13:23:12 +02:00
plot_validation_curve.py EXA Use return_X_y=True with load_digits where appropriate (#14359) 2019-07-14 17:10:54 +02:00

README.txt

.. _model_selection_examples:

Model Selection
-----------------------

Examples related to the :mod:`sklearn.model_selection` module.