flash-attention icon indicating copy to clipboard operation
flash-attention copied to clipboard

Published 20 hours ago • verified publisher icon Dao-AILab

Does flash-attention support RTX 4070ti?

Open RuohuaTang opened this issue 2 years ago • 3 comments

Hi there,

My Windows PC is with one RTX 4070ti. My cuda version is 11.8 and torch version is 2.0.0. I can not install most versions of flash-attn. I can only install flash-attn=1.0.4. But since I can not install flash-attn/csrc/layer_norm and flash-attn/csrc/rotary, I can not benefit from flash-attention.

Is there any method to install flash-attn, flash-attn layer_norm, and flash-attn rotary on my PC?

Thanks in advance!

RuohuaTang avatar Sep 11 '23 03:09 RuohuaTang

I've no experience with Windows. It's only tested on Linux, so WSL would probably work.

tridao avatar Sep 11 '23 03:09 tridao

I‘m using RTX 4060ti 16g and download Flash attn.Most of it works just fine.Though some extensions can't install.(eg. layer_norm rotary)

Slipstream-Max avatar Mar 20 '24 17:03 Slipstream-Max

4060 should also work.

tridao avatar Mar 20 '24 21:03 tridao