lightning/tests/metrics/classification
Tadej Svetina fedc0d1360
Classification metrics overhaul: input formatting standardization (1/n) (#4837)
* Add stuff

* Change metrics documentation layout

* Change testing utils

* Replace len(*.shape) with *.ndim

* More descriptive error message for input formatting

* Replace movedim with permute

* Style changes in error messages

* More error message style improvements

* Fix typo in docs

* Add more descriptive variable names in utils

* Change internal var names

* Break down error checking for inputs into separate functions

* Remove the (N, ..., C) option in MD-MC

* Simplify select_topk

* Remove detach for inputs

* Fix typos

* Update pytorch_lightning/metrics/classification/utils.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update docs/source/metrics.rst

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Minor error message changes

* Update pytorch_lightning/metrics/utils.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Reuse case from validation in formatting

* Refactor code in _input_format_classification

* Small improvements

* PEP 8

* Update pytorch_lightning/metrics/classification/utils.py

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* Update pytorch_lightning/metrics/classification/utils.py

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* Update docs/source/metrics.rst

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* Update pytorch_lightning/metrics/classification/utils.py

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* Alphabetical reordering of regression metrics

* Change default value of top_k and add error checking

* Extract basic validation into separate function

* Update desciption of parameters in input formatting

* Apply suggestions from code review

Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>

* Check that probabilities in preds sum to 1 (for MC)

* Fix coverage

* Minor changes

* Fix edge case and simplify testing

Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2020-12-07 17:49:35 +01:00
..
__init__.py reverted "temporary drop metrics tests while speeding them up" and SKIP (#4115) 2020-10-14 19:01:43 +02:00
inputs.py Classification metrics overhaul: input formatting standardization (1/n) (#4837) 2020-12-07 17:49:35 +01:00
test_accuracy.py [Metrics] Unification of regression (#4166) 2020-10-21 18:05:59 -04:00
test_average_precision.py [Metrics] PrecisionRecallCurve, ROC and AveragePrecision class interface (#4549) 2020-12-04 22:42:23 +01:00
test_confusion_matrix.py [Metrics] Confusion matrix class interface (#4348) 2020-10-30 11:44:25 +01:00
test_f_beta.py [Metrics] Unification of FBeta (#4656) 2020-11-23 09:44:35 +01:00
test_inputs.py Classification metrics overhaul: input formatting standardization (1/n) (#4837) 2020-12-07 17:49:35 +01:00
test_precision_recall.py [Metrics] Unification of regression (#4166) 2020-10-21 18:05:59 -04:00
test_precision_recall_curve.py [Metrics] PrecisionRecallCurve, ROC and AveragePrecision class interface (#4549) 2020-12-04 22:42:23 +01:00
test_roc.py [Metrics] PrecisionRecallCurve, ROC and AveragePrecision class interface (#4549) 2020-12-04 22:42:23 +01:00