xla icon indicating copy to clipboard operation
xla copied to clipboard

Published 20 hours ago • verified publisher icon openxla

Support cuDNN frontend scaled dot product attention for FP8. Part- 1(forward)

Open wenscarl opened this issue 1 year ago • 0 comments

Add cudnn frontend support of scaled dot product attention for FP8 forward. doc here.

wenscarl avatar Jul 18 '24 19:07 wenscarl