pytorch icon indicating copy to clipboard operation
pytorch copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

Use brgemm with pack for Half/BFloat16 flash attention forward kernel

Open CaoE opened this issue 7 months ago • 2 comments

Stack from ghstack (oldest at bottom):

  • #133194
  • -> #131879
  • #131878

cc @jgong5 @mingfeima @XiaobingSuper @sanchitintel @ashokei @jingxu10

CaoE avatar Jul 26 '24 08:07 CaoE