torchmetrics

torchmetrics copied to clipboard

Add classification metrics: `SensitivityAtSpecificity` and `SpecificityAtSensitivity`

6

### Discussed in https://github.com/PyTorchLightning/metrics/discussions/965 Originally posted by **iamharsha1999** April 19, 2022 I was specifically looking for the following two metrics: 1. Sensitivity at Specificity 2. Specificity at Sensitivity However I...

iamharsha1999

Add `DepthScore`

9

## 🚀 Feature Add `DepthScore` ### Sources: - Paper: [A Pseudo-Metric between Probability Distributions based on Depth-Trimmed Regions ](https://arxiv.org/pdf/2103.12711.pdf) - [Repo](https://github.com/PierreColombo/nlg_eval_via_simi_measures/) ### Motivation The recent NLG metrics are more often...

stancld

source links are broken in docs

1

## 📚 Documentation There's something wrong with metrics source redirect: 1. On `stable`, If you click on source, it doesn't show up anything on master which is fine I guess...

rohitgr7

Metrics for Levenshtein edit-distance between two strings

5

## 🚀 Feature I want to calculate `edit_distance` between two strings. I would prefer an API similar to [NLTK.metrics](https://www.nltk.org/api/nltk.metrics.distance.html#module-nltk.metrics.distance) ### Motivation ### Pitch ```python from torchmetrics.functional import edit_distance text1 =...

aniketmaurya

Add `RelativeAverageSpectralError`

9

## What does this PR do? This PR adds a new metric Relative Average Spectral Error (RASE), and Root Mean Squared Error using Sliding Window the metric RASE is based...

Piyush-97

[WIP] Add `METEORScore`

8

## What does this PR do? This PR is currently heavilly WIP. This PR adds a new NLP metric `METEORScore` according to version 1.5 [Meteor Universal: Language Specific Translation Evaluation...

stancld

adding detection.iou

8

## What does this PR do? Adds in IOU and GIOU metrics for object detection. Fixes #659 I took a first attempt at this PR and there are a few...

jscottcronin

Allow arbitrary types for metric states

6

## 🚀 Feature Metric states seem to be limited to `torch.Tensor` or `List[torch.Tensor]`. In my usecase i want to store a dictionary as state. My dataset comprises of samples who...

LarsHill

Generalized Dice Score

1

## 🚀 Feature Generalized Dice Score (= 1 - [Generalized Dice Loss](https://arxiv.org/abs/1707.03237)), to evaluate overall segmentation performance in multiclass scenarios. ### Motivation Nice complement to Dice Score. ### Pitch Addition...

jlcsilva

## 🐛 Bug So I'm not entirely sure whether this is a bug or intentional, in that case this would be a doc fix request. As the title states, the...

tsteffek