rwesterteiger issues

Repositories
Issues
Comments

Results 1 issues of


                                            rwesterteiger

Unexpected CUDA out of memory for minimal example

# Description Loading a simple quantized GGUF model with CUDA fails with: **Error: DriverError(CUDA_ERROR_OUT_OF_MEMORY, "out of memory")** [log.txt](https://github.com/user-attachments/files/17238700/log.txt) # Environment - Linux Mint 21.3 Virginia - GeForce RTX 2060 SUPER...

bug