MagicSource

I am not sure it can be reproduced or not. This is command: ``` eval_datasets='MMBench_DEV_CN MMStar ChartQA_TEST Q-Bench1_VAL MMMU_VAL POPE HallusionBench RealWorldQA MMBench_TEST_EN MMBench_TEST_CN MMBench_TEST_EN_V11 MMBench_TEST_CN_V11 MME' torchrun --nproc-per-node=$num_gpus --master-port=5699...

Am using the latest, in fact, I tried all versions start from a certrain one, the error then keeping appears.

let me rerun this with a fresh enviroment.

Am runing on MME only got this error

Then that's weired, I didn touched anything inside vlmkit, those tsv are automatically downloaded, there must be an key error at some where in some dataset.

Sam issue?

Is it torch issue? am using 2.2 Why do u think it is torch issue? Detected kernel version 4.14.105, which is below the recommended minimum of 5.5.0; this can cause...

hi, how about this warning? It looks like you are trying to rescale already rescaled images. If the input images have pixel values between 0 and 1, set `do_rescale=False` to...

@SeunghyunSEO this is useful. Got a question though. LLava feeds empty images for all text batches, will this make the vit get updated with the dummy data & text input?

看宣传图还以为某种diffusion之类的生图来做ID，但是看起来就是抠图加换背景。anyway，还是非常欣赏开源工作