ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

[BUG]: how to disable FlashAttention

Open SeekPoint opened this issue 1 year ago • 1 comments

🐛 Describe the bug

RuntimeError: FlashAttention only supports Ampere GPUs or newer.

Environment

colossal 0.3.4

ColossalAI/examples/language/opt# bash run_demo.sh

  • pip install -r requirements.txt

SeekPoint avatar Dec 09 '23 10:12 SeekPoint

You can set enable_all_optimization to false. And configure other optimizations as needed.

flybird11111 avatar Dec 11 '23 06:12 flybird11111