willow-inference-server icon indicating copy to clipboard operation
willow-inference-server copied to clipboard

Published 20 hours ago • verified publisher icon toverainc

Adding Distil-Whisper

Open strich opened this issue 1 year ago • 2 comments

Thought I'd add an issue here for adding Distil-Whisper to use in this project as it looks very promising.

strich avatar Nov 02 '23 05:11 strich

I made sure to be up nice and early for when the weights are released today!

After some validation testing we'll be adding support for it.

Note that it is only available in medium (English only) and large.

kristiankielhofner avatar Nov 02 '23 11:11 kristiankielhofner

distil-whisper is only available in medium.en and large-v2 currently. WIS doesn't have the concept of an English only model (I'll work on this) but if you want to test large-v2 it is available.

Put that in your WIS models/tovera-wis-whisper-large-v2 directory and restart WIS.

kristiankielhofner avatar Nov 04 '23 06:11 kristiankielhofner