llama-cpp-python icon indicating copy to clipboard operation
llama-cpp-python copied to clipboard

Published 20 hours ago • verified publisher icon abetlen

Add support for auto setting n_gpu_layers from gguf and available vram size

Open abetlen opened this issue 9 months ago • 0 comments

abetlen avatar May 14 '24 13:05 abetlen