KVQuant icon indicating copy to clipboard operation
KVQuant copied to clipboard
verified publisher icon SqueezeAILab

llama3-7b运行时报错：kernels don't yet support GQA

Open Duze204 opened this issue 4 months ago • 1 comments

Image

Duze204 avatar Aug 11 '25 15:08 Duze204

你好，我也遇见了不支持GQA的问题，请问你解决这个问题了吗

pennyLuo-hub avatar Sep 25 '25 02:09 pennyLuo-hub