sasha-hailo
sasha-hailo
Dear LLMC team, When trying to run LLMC with `opencompass` evaluation (as explained in your documentation and illustrated in a few example YAML files), exceptions are encountered. I see that...
Dear LLMC team, Thank you for introducing support to KV cache quantization, I found it really useful! I'd like to share two observations that affect the correctness and efficiency of...
Dear LLMC team, I've been trying to run mixed-precision PTQ quantization using RTN. I suspect there's a bug, as the **non-default settings in `mix_bits` are ignored**. My understanding of the...
Hello, LLMC team! I was glad to discover that you added support to `HumanEval` benchmark, However, when trying to produce sanity results for unquantized models, they were significantly lower than...
Dear LLMC team, Thank you for your continuous effort to maintain this useful repo. I've been using it for a long period, and would like to draw your attention to...