benchmarks icon indicating copy to clipboard operation
benchmarks copied to clipboard

Published 20 hours ago • verified publisher icon premAI-io

Check if flash attention is supported on the issue or not, and accordingly update on the benchmark specific readme

Open Anindyadeep opened this issue 1 year ago • 2 comments

For each of the benchmark, check if Flash Attention v2 is present or not, if it is present, then use it and mention it on the benchmark specific readme too.

Anindyadeep avatar Dec 04 '23 10:12 Anindyadeep

@Anindyadeep can you update the issue with "check flash attention v2 support"?

nsosio avatar Apr 05 '24 08:04 nsosio

@Anindyadeep can you update the issue with "check flash attention v2 support"?

Done

Anindyadeep avatar Apr 05 '24 09:04 Anindyadeep