vit.triton icon indicating copy to clipboard operation
vit.triton copied to clipboard

Published 20 hours ago • verified publisher icon cmeraki

Fusing matmuls into one

Open romitjain opened this issue 9 months ago • 0 comments

  • Fused Q,K,V projection into one matmul
  • Fused MHA into one single layer instead of concatenation of 12

romitjain avatar May 26 '24 05:05 romitjain