alignment-handbook icon indicating copy to clipboard operation
alignment-handbook copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Downloading latest CUDA version (11.6 or above) for MacOS to use FlashAttention

Open shubhamcs162 opened this issue 11 months ago • 0 comments

It seems that FlashAttention is only supported on CUDA 11.6 and above. According to https://developer.nvidia.com/cuda-downloads, it seems that the latest version of CUDA (12.3) can't be downloaded for MacOS. I would appreciate some suggestions on getting around this issue. Thank you!

shubhamcs162 avatar Mar 05 '24 06:03 shubhamcs162