hlstudio
Results
2
comments of
hlstudio
https://github.com/ollama/ollama/blob/main/docs/faq.md#how-can-i-expose-ollama-on-my-network
Need to install rocm hip sdk first. I successfully ran it in the local rx6600 environment of Win10 ``` D:\Temp>llava-v1.5-7b-q4.llamafile.exe -ngl 999 initializing gpu module... extracting /zip/llama.cpp/ggml.h to C:\Users\levin/.llamafile/ggml.h extracting...