Saeed
Results
31
comments of
Saeed
@skyne98 , AWQ quantization also works with AMD MI50/60. But it is not optimized. I got 5t/s for llama3 8b awq int4.