dinov3 sat distilled in convnext

[AnielAlexa]

Hy, I want to run that dinov3 pretrained on sat dataset on Jetson Orin Nano. The VIT-L seems run very slowly (1-2 FPS) and I want to distill a convnext network for this task. Do you have any ideas or some guidelines? Thank you, Aniel

[ranran9991]

Will be awesome if anybody manages to do this, will definitely be following

[AnielAlexa]

Even VIT S I think is a good approach since visual transformers offer more context rather than CNNs. Also I've try to convert it to tensorRT but no chance.

[AnielAlexa]

Any updates to distill sat into convnext or vitS? @patricklabatut