dinov2

dinov2 copied to clipboard

Failure when not using FSDP mixed precision

1

When training without providing the `mixed_precision` argument to FSDP, there is an error related to dtype mismatch in `dinov2/layers/block.py`. Is this expected? Full stacktrace: ```txt File "/.venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in...

schmidt-ai

Questions about feature maps/patch size

1

I'm still not entirely sure how ViTs learn various features as I've always intuitively understood convnets better. How can I get feature maps that include the color? For my use...

smandava98

ResNet/CNN backbone experiments?

1

Do the authors have any experiments with training or distilling other backbones, e.g. ResNets?

paulgavrikov

pip install command of notebooks makes error because REPO_URL = "https://github.com/facebookresearch/dinov2[extras]" is not a valid editable requirement. Thus, changed to REPO_URL = "git+https://github.com/facebookresearch/dinov2.git#egg=dinov2"

masaishi

Learning rate used for fine-tuning on ImageNet-1k

2

With regards to this sentence: > In Table 5, we show that the Top-1 accuracy on the validation set of ImageNet-1k improves by more than +2% when the backbone is...

MohammedSB

Patch matching implementation details

3

It would be very much appreciated if the code for patch matching (mentioned on page 18 in the paper) could be shared using DINO V2.

yousafe007

model and weight are not compatible

5

I download the 'dinov2_vitl14_pretrain.pth' locally and use the 'vit_large' function to build model. I run the fellowing code. But the weight and the model are not compatible ```python from dinov2.models.vision_transformer...

develop-productivity

Introduce isort linting and apply it

11

Sorted imports by 1.`isort`; 2.`black` (order is important)

leo-gan

pca visualization,use DINOV2 PCA demo on huggingface and got error?who can help me

2

i trained dinov2_vitl14 with custome data that add class on imagenet-1k,and use eval/teacher_checkpoint.pth,and run DINOV2 PCA demo on huggingface,got below:Traceback (most recent call last): File "/home/data-lv/luolu/PycharmProjects/dinov2-pca-master/venv/lib/python3.10/site-packages/gradio/routes.py", line 516, in predict...

luoolu

Unable to replicate downstream depth result on KITTI

4

I evaluate the pretrained dinov2 with different decoder heads on KITTI Eigen Split in order to replicate the paper's numbers. I found the results much worse. Here's what I did....

zshn25