llama-api
llama-api copied to clipboard
exllama GPU split
It's not clear from the documentation how to split VRAM over multiple GPUs with exllama.
It's not clear from the documentation how to split VRAM over multiple GPUs with exllama.