galai icon indicating copy to clipboard operation
galai copied to clipboard

Fine-tuning

Open TheodoreGalanos opened this issue 3 years ago • 1 comments

Any recommendations / advice on how we would go about fine-tuning this model?

TheodoreGalanos avatar Nov 15 '22 22:11 TheodoreGalanos

Friends at HuggingFace working on an integration, think this will be the best route for this.

RJT1990 avatar Nov 15 '22 23:11 RJT1990

Hi @TheodoreGalanos, the checkpoints on HuggingFace hub are now fully compatible with the OPT architecture, so as mentioned by Ross you should be able to use them to fine-tune a model.

mkardas avatar Dec 09 '22 10:12 mkardas