automaticcat
automaticcat
hi @hiento09 can we spin up the azure instance of AMD GPU and test
hi @hiento09 can you set up an instance with the specs like the link below, azure is not working https://gist.github.com/cgmb/6ae0d118bf357fc4576a7568b85e1c45
Tutorial to compile nitro on that system above (details in link https://gist.github.com/cgmb/6ae0d118bf357fc4576a7568b85e1c45 ): First step, install AMD things (for details link: https://gist.github.com/cgmb/6ae0d118bf357fc4576a7568b85e1c45) : After that just build nitro with below...
rename to ROCm support since vulkan already supported
still have ROCm build left @hiento09 @hiro-v
Aye that's true, that's an experimental feature, will add docs when it's more polished
https://github.com/ggerganov/llama.cpp/issues/2708  @hahuyhoang411 can we have any way around this?
https://askubuntu.com/questions/240421/how-to-create-a-deb-file-with-dependency
if you are using "ngl" with value ranging from 0-3x and using a distribution of binary with cuda , it's using gpu, you can tell from the log also when...
i'd recommend not use install script since it's not recently updated, using pure binary file will give you the best experience