FeatUp icon indicating copy to clipboard operation
FeatUp copied to clipboard

How to use it to improve accuracy of my already trained MVD video classifier?

Open gigasurgeon opened this issue 11 months ago • 4 comments

I have trained an MVD video classifier. How can I use this to improve the f1 score or accuracy of my classifier?

gigasurgeon avatar Mar 26 '24 06:03 gigasurgeon

I have the same question when I want to apply this to my segmentation model. How can I apply this.

chien1706 avatar Mar 26 '24 08:03 chien1706

I guess you need to train a new segmentation head on top of the upsampled features from a frozen backbone ?

tcourat avatar Mar 28 '24 09:03 tcourat

I guess you need to train a new segmentation head on top of the upsampled features from a frozen backbone ?

I think the same, in my experiments with FeatUp I found it hard to adapt the decoder or head part of the network to the new features without retraining. I think most networks architecture are not really resolution independent, and downscaling the output of FeatUp would make no sense.

coolteemf avatar Mar 28 '24 14:03 coolteemf

It is a classification model. Vit based. Will featup help in classification tasks?

gigasurgeon avatar Apr 22 '24 08:04 gigasurgeon