Eric Buehler comments

Results 543 comments of


                                            Eric Buehler

Fix quantized example

Thank you

Update README.md

Thank you!

Docker builds fail with "failed to read `/mistralrs/mistralrs-bench/Cargo.toml`"

@LLukas22, do you think you could open a PR to add this? We do depend on pyo3 now in `mistralrs-core`.

Would you kindly update Xlora to support Quantized Models?

@Abdullah-kwl , could you please paste the result of printing `model`?

Would you kindly update Xlora to support Quantized Models?

Thank you. I plan on working on this later today.

Would you kindly update Xlora to support Quantized Models?

@Abdullah-kwl, we have begun work [here](https://github.com/EricLBuehler/xlora/pull/25) and it will be completed shortly.

Loading `tokenizer.model` with Rust API

Ok, I understand. Do you know of a way or a library to do this in Rust without reaching for the Python transformers converter?

Loading `tokenizer.model` with Rust API

@ArthurZucker are there any specifications or example loaders which I can look at to implement this?

distribute with cargo dist?

Hi @ashleygwilliams! I think that this would be a great addition. I think an installer would work best here due to the wide variety of `--features` and also the Python...

Improve getting started docs

@igo, thank you for raising this. I have improved the docs in #221 so it should be clearer. > there is already dir with that name Fixed in #221 >...