distil-whisper icon indicating copy to clipboard operation
distil-whisper copied to clipboard

How to load a fine-tuned model for inference?

Open xinliu9451 opened this issue 7 months ago • 0 comments

@sanchit-gandhi I used the script from https://github.com/huggingface/distil-whisper/tree/main/training/flax/finetuning_scripts to fine-tune a model and obtained a model named flax_model.msgpack. How can I load this model for inference? Additionally, why did the size of the fine-tuned model increase?

xinliu9451 avatar Jul 19 '24 02:07 xinliu9451