whisper-jax icon indicating copy to clipboard operation
whisper-jax copied to clipboard

how to install on Apple Silicon ?

Open ihubgit opened this issue 1 year ago • 6 comments

Hi any easy way to run this locally on my Apple silicon mac ? Any standalone installers for the normal end user ?

ihubgit avatar May 05 '23 14:05 ihubgit

JAX doesn't support Apple silicon - probably the easiest way to get a performance win over OpenAI is to use the Hugging Face Transformers implementation in PyTorch with batching (since you can easily install PyTorch with mps support), see https://huggingface.co/openai/whisper-large-v2#long-form-transcription for details

sanchit-gandhi avatar May 05 '23 14:05 sanchit-gandhi

ok thanks will check it out. Currently whisper jax only tackles EN right ? I'd be interested in FR transcription.

ihubgit avatar May 05 '23 14:05 ihubgit

Nope - both the Transformers and Whisper JAX implementation can handle any language! The language is either inferred from the audio sample, or set by the language argument:

# for French transcription
pred_text = pipeline("audio.mp3", task="transcribe", language="fr")

sanchit-gandhi avatar May 05 '23 14:05 sanchit-gandhi

ok that's definitely interesting then. Thanks.

ihubgit avatar May 05 '23 17:05 ihubgit

does it work on intel macs?

qwertyuiop97 avatar Jan 11 '24 17:01 qwertyuiop97

I'm looking into how I could get it to run locally and essentially try to get it to replace dictation on mac.

qwertyuiop97 avatar Jan 11 '24 17:01 qwertyuiop97