TSTECH
TSTECH
another +1 on this
Gave this a shot both on the beast output port and the raw output port and got some mixed results. On the beast output '30005' using the tcp+raw flag the...
Seeing the same on my end with 13b: ``` llama-gpt-llama-gpt-api-cuda-ggml-1 | llama-gpt-llama-gpt-api-cuda-ggml-1 | /models/llama-2-13b-chat.bin model found. llama-gpt-llama-gpt-api-cuda-ggml-1 | make: *** No rule to make target 'build'. Stop. llama-gpt-llama-gpt-api-cuda-ggml-1 | Initializing...
> Hoping this might help somebody: I was having the same issue, then I updated my NVIDIA drivers and it started working. which driver version did you go to and...
Sorry gents but i think this may still be bugged: Ubuntu 22.04 Nvidia drivers: 545 Cuda Version: 12.3.1 (made change to ./llama-gpt/cuda/*.DockerFile per @Wh1t3Fox suggestion above) Model: 13b Same `make:...
> @tstechnologies the makefile error will always be there as there is not a file. I'm not sure if it is actually meant to be there or not. I also...