ggml icon indicating copy to clipboard operation
ggml copied to clipboard

Published 20 hours ago • verified publisher icon ggerganov

ggml : add NUMA support

Open ggerganov opened this issue 1 year ago • 0 comments

See https://github.com/ggerganov/llama.cpp/pull/1556

The PR not only adds NUMA, but also improves the threading logic in ggml which looks like brings significant speed-up. Needs to be verified for correctness before merging

ggerganov avatar Jun 25 '23 09:06 ggerganov