纪焘 (Tao Ji)

icon indicating a website link https://taoji.eth.link/ icon indicating an email [email protected]

icon company @FudanNLP @AntNLP icon location Shanghai, China icon location My name is Tao. I'm an artist, a programming artist. I'm hired for people to fulfill their fantasies, their DEEP LEARNING fantasies.

Results 1 comments of 纪焘 (Tao Ji)

[Feature Request] Flexible MLA Kernel Supporting More `d`, `dv`, and `n_heads` Values

Hi @chengyupku, thanks for the quick response! I'll take a close look at the GQA implementation, and I'll be sure to share any progress or challenges as they come up....