whisper.cpp icon indicating copy to clipboard operation
whisper.cpp copied to clipboard

Is it possible to load a custom fine-tuned checkpoint from this port?

Open 10-zin opened this issue 1 year ago • 2 comments

Let's say the checkpoint is from the hugging-face training script. I want to transcribe using one of their checkpoints with this port.

10-zin avatar Mar 01 '23 03:03 10-zin

See if the "Fine-tuned models" section has any useful info:

https://github.com/ggerganov/whisper.cpp/tree/master/models#fine-tuned-models

ggerganov avatar Mar 05 '23 19:03 ggerganov

awesome!! @ggerganov I checked that and it works!

However, It is quite slow for the fine-tuned versions in comparison to the standard ones from openai. Any idea why this could be the case?

10-zin avatar Mar 16 '23 10:03 10-zin

Try adding --no-fallback parameter

ggerganov avatar Mar 22 '23 19:03 ggerganov