composable_kernel icon indicating copy to clipboard operation
composable_kernel copied to clipboard

Published 20 hours ago • verified publisher icon ROCmSoftwarePlatform

Add group attention instances

Open rosenrodt opened this issue 2 years ago • 0 comments

We do not have grouped att for now, @rosenrodt . @asroy Do we need instances for group bmm+softmax+gemm+permute

Originally posted by @shaojiewang in https://github.com/ROCmSoftwarePlatform/composable_kernel/issues/425#issuecomment-1252494368

rosenrodt avatar Sep 21 '22 09:09 rosenrodt