ERNIE icon indicating copy to clipboard operation
ERNIE copied to clipboard

Fix Core Attn in ernie 4.5

Open cheng221 opened this issue 4 months ago • 0 comments

Fix Error in These two situation (This PR only affects the self_attention in modeling when use_flash_attention is set to False):

  1. When using the ./tools/inference/infer.py script for inference, setting use_flash_attention results in the following error
image 2. This also exists in ./examples/post-training/sft/scripts/run_0.3b_sft_8k.sh 86a5aa8ce62d232c8b653dab124c9a60

cheng221 avatar Aug 14 '25 08:08 cheng221