iTPN icon indicating copy to clipboard operation
iTPN copied to clipboard

Published 20 hours ago • verified publisher icon sunsmarterjie

A question about CLIP_as_supervision

Open ModulatedConvolutionalNetworks opened this issue 2 years ago • 5 comments

Hello! I think there are some files missing in CLIP_as_supervision. When I want to run pretrain task of iTPN with CLIP as supervision, I find "iTPN_clip_distill" is missing. Can you complete the whole files of CLIP_as_supervision, thanks very much !

ModulatedConvolutionalNetworks avatar Nov 29 '22 09:11 ModulatedConvolutionalNetworks

Sorry for that, I will complete CLIP_as_supervision folder soon.

sunsmarterjie avatar Nov 29 '22 09:11 sunsmarterjie

Thanks for your wonderful job! I also meet the same problem, please offer the missing files in CLIP_as_supervision as possible as soon! Thanks!

HITerStudy avatar Nov 29 '22 10:11 HITerStudy

Done and thanks for the reminder.

sunsmarterjie avatar Nov 29 '22 10:11 sunsmarterjie

Hello, I find some other problems when I run startup_clip.py. The same python env can run main_pretrain.py without clip, but can't run startup_clip.py. There are something missed still, for example, “CLIP_as_supervision/startup_clip.py” report an error: image

“CLIP_as_supervision/datasets.py” report an error: image

Can you offer the env and run demo which can run CLIP_as_supervision? Thanks very much!!

ModulatedConvolutionalNetworks avatar Nov 29 '22 13:11 ModulatedConvolutionalNetworks

I have fixed this error (take care the path of clip model). I use timm==0.4.12 for CLIP_as_supervision. I make the repository by modifying the modelarts code of Huawei, so that some details are different. Contact me through wechat (18843114102) if you encounter other problems. Thanks

sunsmarterjie avatar Nov 29 '22 13:11 sunsmarterjie