jepa icon indicating copy to clipboard operation
jepa copied to clipboard

Published 20 hours ago • verified publisher icon facebookresearch

ViT-tiny encoder

Open jez-moxmo opened this issue 1 year ago • 2 comments

Hi, I can see there are various encoder class configs including a ViT-mini. Will you be releasing one in the future?

jez-moxmo avatar Feb 21 '24 13:02 jez-moxmo

It seems to be missing from ijepa as well, with the following issue which hasnt been responded to. Any comments on whether any of these configs will be released @MidoAssran ?

vedal avatar Mar 30 '24 21:03 vedal

I'm guessing that it just doesn't learn very much. Working on a project using JEPA to train some models, so will try it and let you know.

rolson24 avatar Apr 25 '24 16:04 rolson24