Dr. Hugo Bacard comments

Repositories
Issues
Comments

Results 2 comments of


                                            Dr. Hugo Bacard

Inferencing with adapter vs Inferencing with fused model

Hi awni, Thank you for your response :) - Actually I fine-tuned the model after converting it with the `-q` flag so I guess it's a quantized model, hence QLoRA....

llama-cpp-python not using GPU on m1

I have an M2 chip and I've noticed something : - When I use an earlier version `llama-cpp-python==0.1.83` then my GPU is activated :) - However when I use the...