Wagner Bruna
Results
13
issues of
Wagner Bruna
A simple POC for adding a version string to the library and main.cpp (#1005). The CMake logic comes directly from `ggml/CMakeLists.txt`. I opted for adding a define to a specific...
Introduces a new `--use-mmap` flag that replaces model loading I/O operations with `mmap` + `memcpy`. In my tests, this helps model loading speed slightly, though the gain was never higher...
Fixes #1076 for me (ROCm).