whisper.cpp icon indicating copy to clipboard operation
whisper.cpp copied to clipboard

Published 20 hours ago • verified publisher icon ggerganov

mmap support

Open dsseng opened this issue 2 years ago • 1 comments

As an experiment it would be interesting to alter the ggml format a bit and then mmap it directly. Maybe this coulde reduce memory pressure for small systems

dsseng avatar Mar 19 '23 14:03 dsseng

Related: https://github.com/ggerganov/llama.cpp/issues/91

j-f1 avatar Mar 20 '23 01:03 j-f1