KVQuant icon indicating copy to clipboard operation
KVQuant copied to clipboard

llama3-7b运行时报错:kernels don't yet support GQA

Open Duze204 opened this issue 4 months ago • 1 comments

Image

Duze204 avatar Aug 11 '25 15:08 Duze204

你好,我也遇见了不支持GQA的问题,请问你解决这个问题了吗

pennyLuo-hub avatar Sep 25 '25 02:09 pennyLuo-hub