InternLM-XComposer icon indicating copy to clipboard operation
InternLM-XComposer copied to clipboard

Published 20 hours ago • verified publisher icon InternLM

InternLM-XComposer2-4KHD-7B 多卡推理

Open parasol-ry opened this issue 1 year ago • 2 comments

请问一下 InternLM-XComposer2-4KHD-7B 如何多卡推理，单卡 A100 40G 显存提示不够

parasol-ry avatar Apr 11 '24 03:04 parasol-ry

https://github.com/InternLM/InternLM-XComposer?tab=readme-ov-file#inference-on-multiple-gpus try this one

LightDXY avatar Apr 11 '24 05:04 LightDXY

https://github.com/InternLM/InternLM-XComposer?tab=readme-ov-file#inference-on-multiple-gpus try this one

not work；Why need so much memory? 7B https://github.com/InternLM/InternLM-XComposer/issues/265

Cloopen-ReLiNK avatar Apr 17 '24 06:04 Cloopen-ReLiNK