Rodrigo issues

Repositories
Issues
Comments

Results 1 issues of


                                            Rodrigo

Unexpected behavior: Model loads on single GPU but fails on dual GPU setup

### Describe the bug I'm experiencing an unexpected behavior when trying to load the following model: Model name: Mistral-Large-Instruct-2407-IMat-GGUF Quantization: Q6_K, size 100.59GB When using a single GPU (RTX 3080...

bug