flash-attention icon indicating copy to clipboard operation
flash-attention copied to clipboard

Published 20 hours ago • verified publisher icon Dao-AILab

Does flash-attention2 support L40?

Open askcs517 opened this issue 1 year ago • 2 comments
trafficstars

Does flash-attention2 support L40?

askcs517 avatar Apr 26 '24 16:04 askcs517

Yes

tridao avatar Apr 26 '24 17:04 tridao

where to view？I train llm by 8*L40，when i set flashattn=true，there has No speed boost？how to explain？

askcs517 avatar Apr 26 '24 17:04 askcs517