Guy S Garcia

If theres nobody working on this I could tackle it in the week

Is there currently a way to convert models to ggml format? Im close to getting quantize into a working demo and was wondering if this should also be ported for...

I have no problem working on it after I finish this issue. Another question, how should the feature be used? Should it be another argument in the cli app?

Is there any update on this PR?

> Are you running into same issue? Yes, and its happening in the same Authz context