lightllm icon indicating copy to clipboard operation
lightllm copied to clipboard
verified publisher icon ModelTC

Will lightllm support low bit quantization?

Open MeJerry215 opened this issue 8 months ago • 1 comments

Something Like GGUF 1bit and 2bit quantization?

MeJerry215 avatar Mar 17 '25 06:03 MeJerry215

not supported now, will support this feature in future。

hiworldwzj avatar Mar 17 '25 07:03 hiworldwzj