repetition penalty

[SuXuping]

Question

when i try to use repetition_penalty to avoid repeat answer, i met this error "cuda error:device-side assert triggered". After my debug, i found that the input_ids include -200 which is default image token. i guess this is the reason of this " cuda error:device-side assert triggered". can you fix this error?

[Jeckinchen]

Hello，have you solved this problem? I also encountered the problem of repeated responses after fine-tuning the model.

[redscv]

I had the same error after set repetition_penalty > 0

[LanYu4qz]

I have also encountered this issue. Who can solve it?

[SuXuping]

I have also encountered this issue. Who can solve it? change -200 to a new positive num

[LanYu4qz]

I have also encountered this issue. Who can solve it? change -200 to a new positive num

Could you give me some guidance on how to do it specifically?

[zhangsha1024]

same here