llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Add batch files for automatic installation on Windows

Open glencoe2004 opened this issue 1 year ago • 0 comments

This commit adds two new files, Windows-installer.bat and Windows-model_conversion.bat, both of which serve to make using llama.cpp on Windows easier. Windows-installer.bat installs dependencies, such as Python, and Windows-model_conversion.bat converts the 7B model to FP16, and quantizises to 4 bit. Additionally, as Windows-model_conversion.bat builds llama.cpp with CMake, it should resolve issue #103. Note that Windows-model_conversion.bat only currently processes 7B.

Occasionally, Windows-installer.bat will throw an "Unable to complete job - 0x80200002" error. This has no impact on the functionality of the bat file.

While the .bat files still have a few issues (tons of harmless errors if you run Windows-installer.bat after venv creation, Windows-model_conversion.bat only converting and quantizing the 7B model, etc.) being able to install llama.cpp automatically makes the project much easier to use than what we currently have.

glencoe2004 avatar Mar 15 '23 23:03 glencoe2004