xmc-andy

Hey, I would like to ask you that I am doing a two-classification task with single prompt and multiple images as input, but the result does not seem to be...

Thanks for sharing. I am now training Otter to treat multiple pictures as videos. Since the number of pictures is of variable length, batchsize=1 is currently used for processing. Later...

> Thank you for your interest. > > Accomplishing a multi-image response with a single instruction can be easily done by adhering to the dataset format found here: > >...

Got it, thank u.

Thank you so much!

OK，thank u，I also want to ask about the main thread memory is higher than other threads and overflow situation, how I should solve it, do you have suggestions? ---- Replied...

Thank u for your shared suggestions, I will try them,

I tried setting device_map to 'auto', 'balanced', 'balanced_low_0' or 'sequential' respectively. Unfortunately, it still overflows the memory on 3 V100s (unfrozen ViT). In comparison, I think balanced_low_0 is It might...