ColossalAI
                                
                                 ColossalAI copied to clipboard
                                
                                    ColossalAI copied to clipboard
                            
                            
                            
                        [BUG]: how to disable FlashAttention
🐛 Describe the bug
RuntimeError: FlashAttention only supports Ampere GPUs or newer.
Environment
colossal 0.3.4
ColossalAI/examples/language/opt# bash run_demo.sh
- pip install -r requirements.txt
You can set enable_all_optimization to false. And configure other optimizations as needed.