Pclanglais

Speed up model.generate() with coca?

4

I am building an image classification workflow on top of coca captions and embeddings. The only downside is that this is slow (about 100/images per minute on a google colab)....