Transfer-Learning-Library icon indicating copy to clipboard operation
Transfer-Learning-Library copied to clipboard
verified publisher icon thuml

Why no torchmetrics for computing test time accuracy?

Open Ambuj-Choudha opened this issue 1 year ago • 1 comments

I noticed that there is a deviation from standard practice, during test time, the accuracy metric is just using 'top1' accuracy and it is not getting averaged across classes!

In short, two questions:

  • Why only top1 during test time? (and then, what does "origin" means, does that also mean Top1 test accu.) error

  • Why not use the metrics from pytorch?

Ambuj-Choudha avatar Dec 10 '24 15:12 Ambuj-Choudha

Hey any updates on this? @phamour @microhhh @longmingsheng. @thucbx99 (you answered some of the questions, pls can you answer if you know)

Also, I wanted to ask is there a possibility in near future that ViT backbones are added?

Ambuj-Choudha avatar Mar 05 '25 13:03 Ambuj-Choudha