metavoice-src icon indicating copy to clipboard operation
metavoice-src copied to clipboard

Published 20 hours ago • verified publisher icon metavoiceio

Support to Brazilian Portuguese

Open paulovasconcellos-hotmart opened this issue 11 months ago • 1 comments

Hi, will Metavoice support languages such as Brazilian Portuguese? I've noticed that the fine-tuning code is not available yet. Is it possible to contribute in some way?

paulovasconcellos-hotmart avatar Mar 12 '24 11:03 paulovasconcellos-hotmart

Hey @paulovasconcellos-hotmart , we've just published an initial approach for finetuning the last N transformer blocks of the first stage LLM. Best to play around with the hyperparams in finetune_params.py as we didn't determine the optimal set. Let us know if you have any issues or if you're up for contributing any improvements (via param sweep or otherwise!)

Next step to improve finetuning effectiveness is to have LoRA adapters for the first stage LLM which is being worked on here.

lucapericlp avatar Mar 14 '24 13:03 lucapericlp

Closing due to inactivity.

lucapericlp avatar May 14 '24 21:05 lucapericlp