Zero Shot inference Top-1 Score Issue

[saltandlight]

trafficstars

I have followed your zero shot inference Colab code with custom dataset. But Top-1 Accuracy =1.73 and Top-5 Accuracy = 4.74. I think that these accuaracy value is not reasonable so these hypothesis can be true.

1. I missed something about your code
2. These inference can not be trusted and code or model should be updated...

[jongwook]

안녕하세요!

I'd suspect if the class labels were inadvertently shuffled or mismatched. To verify, it'll be helpful to inspect the classification results for the individual images. As in the example notebook, you could try plotting the image along with the probability distribution of the top 5 labels (or the corresponding zero-shot prompts):