Alden Johnson comments

Repositories
Issues
Comments

Results 2 comments of


                                            Alden Johnson

FP16 and 4-bit quantized model both produce garbage output on M1 8GB

@v3ss0n could you please elaborate?

FP16 and 4-bit quantized model both produce garbage output on M1 8GB

I found the solution to my issue! make sure that when you're using the `convert-pth-to-ggml.py` script that it completes and tells you `Done. Output file:` I was getting the error...