llm_interview_note icon indicating copy to clipboard operation
llm_interview_note copied to clipboard
Published 8 months ago • verified publisher icon wdndev

MHA_MQA_GQA代码

Open TS-mark opened this issue 1 year ago • 0 comments

总结的很好，有一个小问题

        if attention_mask != None:
            attention_scores += attention_mask * -1e-9

这里这个值应该是-1e9

TS-mark avatar Aug 19 '24 05:08 TS-mark