torchmetrics icon indicating copy to clipboard operation
torchmetrics copied to clipboard

Can't access metrics in a MetricCollection via keys returned in MetricCollection.keys

Open spott opened this issue 1 year ago • 0 comments

🐛 Bug

print(list(self.val_metrics_macro.keys())) # prints "['val/MulticlassAccuracy/macro', 'val/MulticlassF1Score/macro', 'val/MulticlassPrecision/macro', 'val/MulticlassRecall/macro']" print( f'val/accuracy/macro: {self.val_metrics_macro["val/MulticlassAccuracy/macro"].compute():.4}' ) # throws error: KeyError: 'val/MulticlassAccuracy/macro'

Expected behavior

If a key shows up in .keys it should be a valid key in __getitem__.

Environment

  • TorchMetrics version (and how you installed TM, e.g. conda, pip, build from source): 1.3.1
  • Python & PyTorch Version (e.g., 1.0): torch 2.2.0, python 3.10.12
  • Any other relevant information such as OS (e.g., Linux): MacOS

spott avatar Feb 21 '24 17:02 spott