AI-Scientist icon indicating copy to clipboard operation
AI-Scientist copied to clipboard
verified publisher icon SakanaAI

Which versions of PyTorch and CUDA are being used?

Open 3-body opened this issue 1 year ago • 2 comments

The console reports a warning: " UserWarning: 1Torch was not compiled with flash attention." Maybe some mistake from the mismatched version of torch and cuda. My env config is "troch2.4.0+cuda12.4'"

3-body avatar Aug 19 '24 10:08 3-body

Confirmed working using 2.0.1 and CUDA 12.2, I would look at the flash attention repos for advice on this issue!

conglu1997 avatar Aug 19 '24 15:08 conglu1997

Confirmed working using 2.0.1 and CUDA 12.2, I would look at the flash attention repos for advice on this issue!

Got it，thanks

3-body avatar Aug 20 '24 01:08 3-body