Ibraheem-gomotive

Hi @yutong-xiang-97 I noticed that you are distilling from the CLS token's embedding outputted by DINOv3. I was wondering if we can choose to distill using the entire feature map,...

@guarin in the `distillationv2.py` file, in the `get_teacher method`, `teacher_embedding_model.eval()` is being called, which means when this part is called, it only returns the embedding of the CLS token, not...

Got it, thanks for sharing that. Curious to know, where to able to get a stronger/comparable backbone with this kind of distillation compared to imagnet pretrained backbone?

@guarin not directly relevant to our previous conversion, but have you experimented with distilling DINO models into YOLO models that output an FPN based backbone? How would you go about...