open_clip
open_clip copied to clipboard
mlfoundations
CLIP training in Jax.
Would be nice if we could add a jax_src folder which supported training CLIP models in Jax.
This would also help with https://github.com/mlfoundations/open_clip/issues/20.
I would be interested in contributing to this - are there any guidelines, a roadmap, etc. I need to follow, or should I begin with a simple baseline in a separate repository and gradually expand it?
Ya at a high level we were just thinking this would be something beneficial for the community, but no concrete plans -- an open_clip_jax repo would be great!
Okay, thank you for clarifying that. I will implement a baseline and keep you up-to-date.
The past few months have been quite busy for me, but I've been slowly chipping away at an open_clip_jax project here as a starting point. It is very much a work in progress and likely to be riddled with bugs but supports basic functionalities such as inference with pre-trained models and training (single- and multi-worker), with more features planned for the near future.