torchmetrics
torchmetrics copied to clipboard
Can't access metrics in a MetricCollection via keys returned in MetricCollection.keys
🐛 Bug
print(list(self.val_metrics_macro.keys())) # prints "['val/MulticlassAccuracy/macro', 'val/MulticlassF1Score/macro', 'val/MulticlassPrecision/macro', 'val/MulticlassRecall/macro']" print( f'val/accuracy/macro: {self.val_metrics_macro["val/MulticlassAccuracy/macro"].compute():.4}' ) # throws error: KeyError: 'val/MulticlassAccuracy/macro'
Expected behavior
If a key shows up in .keys
it should be a valid key in __getitem__
.
Environment
- TorchMetrics version (and how you installed TM, e.g.
conda
,pip
, build from source): 1.3.1 - Python & PyTorch Version (e.g., 1.0): torch 2.2.0, python 3.10.12
- Any other relevant information such as OS (e.g., Linux): MacOS