whisper.cpp icon indicating copy to clipboard operation
whisper.cpp copied to clipboard

Published 20 hours ago • verified publisher icon ggerganov

Difference between whisper-bin and whisper-blas-bin ?

Open jishnudg opened this issue 1 year ago • 1 comments

I'm not familiar with the architecture, would appreciate a quick ELI5 explanation of this - - thanks!

jishnudg avatar Mar 01 '23 15:03 jishnudg

whisper.cpp has a built-in matrix-multiplication routine. Additionally, it supports using a 3rd party matrix multiplication provided by the OpenBLAS library. Which one is faster depends on the CPU and hardware that you are running it on.

  • whisper-bin uses the built-in routine
  • whisper-blas-bin uses the 3rd party OpenBLAS routine

You can see which one performs better for you

ggerganov avatar Mar 05 '23 19:03 ggerganov