QLLM icon indicating copy to clipboard operation
QLLM copied to clipboard

Published 20 hours ago • verified publisher icon ModelTC
→

Metadata

[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"

Results 1 QLLM issues
Sort by recently updated
recently updated
newest added

Is there a bug?

1 comment

Thanks for your wonderful works. Is there a bug in: https://github.com/ModelTC/QLLM/blob/main/models/int_llama_layer.py#L291

sunnyxiaohu avatar sunnyxiaohu

← Metadata

33
Stars
2
Forks
Watchers

Owner

verified publisher icon ModelTC

Metadata

[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"

Back