Yu-won Lee
Yu-won Lee
@Mypainismorethanyours I've updated the code for cls trainer. Thanks for letting me know.
I'll update the trl version and test once more. Thanks for letting me know!
~I think it won't have a problem with the `trl==0.25.0`.~ I've updated the code for grpo. You could try it. Also for now, you sould put the `` token inside...
I'm not sure what is causing the error. Can you post the full error log please?
@noname509 Can I see your dataset sample? I think it's kinda problem of dataset thing.
@shoiabshafi I can't reproduce the error. Main issue would be a mismatch with `imgae_gird_thw` but, I don't know the full data so I'm not sure. Are you using a mixed-modality...
I'm testing with the data `lmms-lab/multimodal-open-r1-8k-verified` formatted as follows. ``` { "id": "f1efd225-1d27-45f1-be43-90268e4cc39c", "image": "image_10.jpg", "conversations": [ { "from": "human", "value": "Based on the image of the right triangle, determine...
Does some part of data has multi-image? It's a mismatch with a token number and the image_grid_thw. I'm not sure what part causes the error right now in your settings.
@shoiabshafi @noname509 Please check once again that you've removed all `` and `` token in your dataset. I think this is the reason for the issue.
I think it's becuase the embedding parameteres are empty in your model. Check with this code if the adapter is loaded wrong. ``` # Before PEFT print("base in/out:", model.get_input_embeddings().weight.shape, model.get_output_embeddings().weight.shape)...