Turing GPU support

[sumanthnallamotu]

In reference to the following on the main page:

"FlashAttention-2 currently supports: Ampere, Ada, or Hopper GPUs (e.g., A100, RTX 3090, RTX 4090, H100). Support for Turing GPUs (T4, RTX 2080) is coming soon, please use FlashAttention 1.x for Turing GPUs for now. Datatype fp16 and bf16 (bf16 requires Ampere, Ada, or Hopper GPUs). All head dimensions up to 256. Head dim > 192 backward requires A100/A800 or H100/H800."

How soon can we expect support for Turing GPU's? Some models I'd like to use are based on Mistral, which requires FlashAttention v2.

Specifically, I'm looking for support with T4.

Thank you!

[WingsLong]

Me too!

[IvoryTower800]

Me too!

[online2311]

Me too!

[laoda513]

me too, too LoL

[mirh]

Duplicate of #542

[zbh2047]

Me too!

[giopaglia]

And me too :+1:

[vigourwu]

Any progress？

[kaiyuanlee]

me too