DeepSpeedExamples icon indicating copy to clipboard operation
DeepSpeedExamples copied to clipboard
verified publisher icon microsoft

Assertion `srcIndex < srcSelectDimSize` failed

Open boqiny opened this issue 11 months ago • 1 comments

When I try to run Stage 3 finetuning PPO for qwen 2 0.5B model, I got the following bug:

Assertion srcIndex < srcSelectDimSize failed, which seems like issue about input dataset sequence length?

I have already set Num_Padding_at_Beginning=0 # this is model related

Image

boqiny avatar Dec 18 '24 06:12 boqiny

@boqiny - do you have a full repro script? And can you share the device type and info about the system you're on?

loadams avatar Jan 24 '25 18:01 loadams