AutoAWQ icon indicating copy to clipboard operation
AutoAWQ copied to clipboard

gemv_fast kernel only suppor 128 group_size

Open thincal opened this issue 2 months ago • 1 comments

It seems that only 128 group_size is supported by new gemv_fast kernel, is there any constrains for other group_size such as 64 ?

thincal avatar Apr 09 '24 02:04 thincal