alignment-handbook icon indicating copy to clipboard operation
alignment-handbook copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

About Flash Attn's version

Open chengjl19 opened this issue 1 year ago • 1 comments

I encountered this error (importerror: /flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol) and I tried many ways to solve it but failed. Could you kindly share your version of flash-attn?

chengjl19 avatar Dec 27 '23 16:12 chengjl19

Hello @chengjl19 we are using flash-attn==2.3.6 and will ping this in the linked PR. If you have trouble installing it via pip have you tried installing from source?

lewtun avatar Jan 04 '24 22:01 lewtun