Fovercon

When seq_parallel_world_size is set to a value greater than 1, should use_varlen_attn not be set to true?

2

I'm working on the 32k long text SFT for Qwen2 72b. When I set **seq_parallel_world_size** to greater than one and **use_varlen_attn to true**, an error occurs. After checking, the error...