PaDiM icon indicating copy to clipboard operation
PaDiM copied to clipboard

PaDiM Shared Performance

Open ingbeeedd opened this issue 3 years ago • 4 comments

How much is the difference in performance compare to original PaDiM?

ingbeeedd avatar Dec 15 '21 06:12 ingbeeedd

I think it really depends on the kind of images you are dealing with.

For texture images where the normal data has a small number of modalities then a shared variant may be good enough.

For objects where the location is the patches are very different based on their location on the image then it won't work as well.

Doing a quick test on 2 mvtec datasets:

Dataset PRO Score ROCAUC
Tile (texture) 86% 84%
Pill (objects) 82% 44%

The main advantage being the much smaller memory footprint and not really performance.

Pangoraw avatar Dec 15 '21 17:12 Pangoraw

How much did you test batch size? Wouldn't the performance be close if it was a little large test batch size?

ingbeeedd avatar Dec 16 '21 05:12 ingbeeedd

I won't expect the batch size to have any impact on the performance since batch samples don't interact with each other. What impact do you think it could have ?

Pangoraw avatar Dec 16 '21 08:12 Pangoraw

I'll leave it after a test

ingbeeedd avatar Dec 21 '21 13:12 ingbeeedd