Paddle icon indicating copy to clipboard operation
Paddle copied to clipboard

Published 20 hours ago • verified publisher icon PaddlePaddle

Fix test_flash_attention on sm_8x devices

Open Tom-Zheng opened this issue 6 months ago • 2 comments

PR Category

Operator Mechanism

PR Types

Bug fixes

Description

Fixes test_flash_attention on sm_8x devices. Reason: sm_86 & sm_89 does not support flash attention bwd kernel for D > 192.

Tom-Zheng avatar Aug 19 '24 08:08 Tom-Zheng