torch_flops icon indicating copy to clipboard operation
torch_flops copied to clipboard

Published 20 hours ago • verified publisher icon zugexiaodui

有计划对torch2.0 SDPA算子的支持吗？

Open tenderness-git opened this issue 4 months ago • 1 comments

torch2添加了 scaled dot product attention算子，基于flash attn，目前用途很多，作者有对这个支持的计划吗

tenderness-git avatar Feb 29 '24 08:02 tenderness-git