eileen2003-w

How can I install a feaible Flash-Attention version on my Turing GPU?

2

I have read the text and found that I have to install the flash-attn1.x to fit my Turing GPU, so I get the source package from github: https://github.com/Dao-AILab/flash-attention/releases?page=6. Then I...

WHEN can we get the flash-attention 2.x for Turing GPU ?

6

I have already downloaded Flash-attention 1.x(actually flash-attn 1.0.8) because currently I only have a GPU with TURING architecture(TITAN RTX). But for my needs (running a demo of a multimodal LLM),...