AttributeError: 'Qwen2FlashAttention2' object has no attribute '_flash_attention_forward'

[zhangyuqi-1]

https://github.com/modelscope/ms-swift/issues/2107#issuecomment-2370042882

xtuner 0.1.23

[rank1]: File "/data1/zhangyq/miniforge3/envs/py310/lib/python3.10/site-packages/xtuner/model/modules/dispatch/qwen2.py", line 160, in qwen2_attn_forward [rank1]: attn_output = self._flash_attention_forward( [rank1]: File "/data1/zhangyq/miniforge3/envs/py310/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1729, in getattr [rank1]: raise AttributeError(f"'{type(self).name}' object has no attribute '{name}'") [rank1]: AttributeError: 'Qwen2FlashAttention2' object has no attribute '_flash_attention_forward'