whisper.cpp icon indicating copy to clipboard operation
whisper.cpp copied to clipboard

Published 20 hours ago • verified publisher icon ggerganov

Diminishing returns with increasing number of threads

Open savchenko opened this issue 1 year ago • 15 comments

It seems like 7 threads is a sweet-spot after which performance starts decreasing:

cpp

Is this expected?

Latest build from the GitHub Workflows
Windows 21H2
AMD 3700X

savchenko avatar Nov 29 '22 04:11 savchenko