llama.cpp
llama.cpp copied to clipboard
Add batch files for automatic installation on Windows
This commit adds two new files, Windows-installer.bat and Windows-model_conversion.bat, both of which serve to make using llama.cpp on Windows easier. Windows-installer.bat installs dependencies, such as Python, and Windows-model_conversion.bat converts the 7B model to FP16, and quantizises to 4 bit. Additionally, as Windows-model_conversion.bat builds llama.cpp with CMake, it should resolve issue #103. Note that Windows-model_conversion.bat only currently processes 7B.
Occasionally, Windows-installer.bat will throw an "Unable to complete job - 0x80200002" error. This has no impact on the functionality of the bat file.
While the .bat files still have a few issues (tons of harmless errors if you run Windows-installer.bat after venv creation, Windows-model_conversion.bat only converting and quantizing the 7B model, etc.) being able to install llama.cpp automatically makes the project much easier to use than what we currently have.