Konstantin Korolev

icon indicating a website link @advprop

icon location Aspiring founder

Results 1 comments of Konstantin Korolev

[Bug]: 0.6.3.post1 regression: RuntimeError during mem profiling on Mistral Large AWQ with `-q awq_marlin`

Same here! Affects newer models with AutoAWQ quants.