HistoSSLscaling icon indicating copy to clipboard operation
HistoSSLscaling copied to clipboard

Are there any other model weights?

Open yangzhou321 opened this issue 2 years ago • 1 comments

hi~ I just found that you mentioned in this repo that data features were extracted from some models like "ResNet50, MoCoWideResNetCOAD, iBOTViTSmallCOAD, iBOTViTBaseCOAD, iBOTViTBasePANCAN, iBOTViTLargeCOAD". I recently found that the pre-trained "phikon" (ViT-base) model you provided does not seem to perform well on my own dataset. Are there any pre-trained weights of these models? Perhaps the performance of ViT-L is better on certain datasets? Could you please provide me with some pre-trained vit-large models iBOT-ViT-Large-COAD or iBOT-ViT-Large-PANCAN? Thanks a lot.

yangzhou321 avatar Dec 30 '23 05:12 yangzhou321

Hi @yangzhou321 ! Thanks for your feedback. Do you use the teacher backbone to extract features ? What is the task you're trying to solve if I may ?

As of now, we don't plan to release further weights on this repo (like iBOT-ViT-Large-COAD or iBOT-ViT-Large-PANCAN) but stay tuned, some may be released in the coming weeks.

Also, iBOTViTBasePANCAN (aka Phikon on Hugging-Face) is the more complete model in terms of generalization to different cancer indications; but of course you may find better results with specialized / fine-tuned models (for instance, CRC-trained models for CRC-related tasks).

afilt avatar Jan 03 '24 09:01 afilt