cooperdk
cooperdk
Your AMD GPU will never mean much in AI, which is basically only supported on nVidia CUDA. But, this specific software is (for reasons unknown) CPU only, which makes it...
Not with this code. This is just a fancy frontend for alpaca.cpp which only supports Alpaca-7b. You should use llama.cpp https://github.com/ggerganov/llama.cpp With that, you can run both the Alpaca 13b...
@Nguyenpham89 - try again
try executing the chat app in resources/models/(OS) and see what happens...
It is a CLI application, so execute it in terminal or command prompt. You will have to direct it to the model location and run it in interactive mode, something...
> Can you help me? Why I got nothing? You don't get a response at all? Do you get the opportunity back to write a new command, or does it...
Yeah, then you should hold your breath. For a long time. With those specs it will take a lot of time for the model to be ready and it will...
Yeah, then you should hold your breath. For a long time. With those specs it will take a lot of time for the model to be ready and it will...
> GTX 3070 8GB with Ryzen 7 and 16GB RAM. Rarely, it will respond quickly. But the majority of time, it never answers. I've left it overnight and still no...
Why... why? Also, eh, WHY.