llm-foundry icon indicating copy to clipboard operation
llm-foundry copied to clipboard

Installation issue from habana_alpha branch

Open palash04 opened this issue 1 year ago • 2 comments

Screenshot 2024-04-04 at 3 54 03 PM

palash04 avatar Apr 04 '24 11:04 palash04

Removed flash attn dependencies from requirements.txt, and it worked. Should it be installed for gaudi?

palash04 avatar Apr 04 '24 13:04 palash04

That's right, the flash-attn dependenices should not be required for Gaudi. If you'd like to submit a PR to this branch editing the setup.py requirements, please go for it!

abhi-mosaic avatar Apr 04 '24 21:04 abhi-mosaic