openai-whisper-cpu

openai-whisper-cpu copied to clipboard

Model not quantized

2

I tried to use the technique on 3 (tiny, base and small) models but the model sizes remain the same as original. I don't think this worked on Windows 11...

Jawad1347

i tried running this at vm and i got this error Traceback (most recent call last): File "/usr/bin/whisper", line 33, in sys.exit(load_entry_point('whisper', 'console_scripts', 'whisper')()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/bin/whisper", line 25, in...

Brilliancoder

Slower results from quantized model potentially due to warning prints

4

I'm getting the following warning which prints probably 1000 times during execution: [W qlinear_dynamic.cpp:239] Warning: Currently, qnnpack incorrectly ignores reduce_range when it is set to true; this may change in...

Mijawel

whisper not found error

1

I have followed the steps in the readme but I cannot run whisper on Ubuntu Command: ``` whisper audio.wav --model large ``` Error: ``` Command 'whisper' not found, did you...

vinny-888

hi i try it on terminal but it seems it doesn't work .... where can i type those comands?

Skilatchi2020

Does not seem to work on older CPUs

1

Hello @MiscellaneousStuff ! Hope you are well. I recently learned about whisper and was eager to try your CPU-based adaptation for speed increase. However, me not being too rich, I...

qwertyuu

It would be good to throw some quick accuracy measurements alongside your posted wall-time figures. This may also become useful to track degradation/improvement against changes and updates, but would require...

willupowers

Can I save the quantized model to disk to avoid calling `torch.quantization.quantize_dynamic` each times?

2

I've managed to run custom_whisper.py, but I'm thinking if we can save the quantization to disk, and let the whisper CLI (with the modified `nn.Linear` part) use it like other...

shy2052

 This is the medium model. The performance takes a quite huge hit because it now can't find English words while Turkish is being spoken. There's still this warning; ```...

hamsipower

Docker Build error

1

When I run the `docker build` command, the following error occurs: ``` ERROR: failed to solve: nvcr.io/nvidia/pytorch:py3-20.12: failed to resolve source metadata for nvcr.io/nvidia/pytorch:py3-20.12: nvcr.io/nvidia/pytorch:py3-20.12: not found ```

shivanraptor