InternVL icon indicating copy to clipboard operation
InternVL copied to clipboard

Large 34B model OOM in evaluation

Open kyleliang919 opened this issue 1 year ago • 1 comments

This line allocates the whole model onto GPU:0 again, should have used device_map="auto" when loading. https://github.com/OpenGVLab/InternVL/blob/2577068ba16fb3c17901fb3479a48b580c99c00b/internvl_chat/eval/mmmu/evaluate_mmmu.py#L286

kyleliang919 avatar May 09 '24 02:05 kyleliang919

Thanks for your feedback.

czczup avatar May 09 '24 06:05 czczup