Alexey Shaturnyy
Alexey Shaturnyy
@gpucce Hi. https://pastebin.com/9psDYWhY These are all the logs that I see when I put resume. After the last line immediately OOM. https://www.kaggle.com/code/leonidkulyk/openclip-coca-fine-tuning-w-b-optimized This is how the checkpoint was obtained. I...
@gpucce 1) Firstly I started the notebook( https://www.kaggle.com/code/leonidkulyk/openclip-coca-fine-tuning-w-b-optimized) without resume to train first one epoch. The only thing I changed was to make the dataset twice larger(added 100k pics). All...
I have uploaded 7GB checkpoint as dataset to kaggle. Can i give you access to it?
@gpucce Is there way to generate several outputs using top_k/top_p sampling for CoCa? May be there is some parameter like "num_return_sequences" in hugging face? I have not found anything like...
@gpucce The main problem is generating several results. Could you help to do it?
@gpucce I solved the problem with memory overflow when resuming training. Most of the difficulties arose with the generation of several results using CoCa. As far as I know, it...
@gpucce If you are busy, can you please at least briefly say where to start? I have never done it myself.
@gpucce beam search
@gpucce ok
@gpucce Should we expect that in the near future it will be possible to generate multiple results with CoCa in openclip? I think this will be useful to many.