Christian Huettig

icon indicating a website link https://helmholtz.software/software/gaia icon indicating an email [email protected]

icon company DLR icon location Berlin, Germany icon location Embedded SW / CFD / HPC / Numerics / Algorithms https://helmholtz.software/software/gaia

Results 11 comments of Christian Huettig

Incorrect NUMA detection logic, fails for AMD Threadripper 1950X

I'm also using Threadripper with active NUMA and see even a larger boost, almost 80% faster with llama.cpp when using the same model with --numa=distribute . Started experimenting when the...