LLaMA-Adapter icon indicating copy to clipboard operation
LLaMA-Adapter copied to clipboard

Published 20 hours ago • verified publisher icon ZrrSkywalker

multi-gpu

Open pengwei-iie opened this issue 1 year ago • 1 comments

"AssertionError: Loading a checkpoint for MP=1 but world size is 2" when I set --nproc_per_node to 2.

How to run on 2 16G gpu? because it OOM when inference.

Thanks

pengwei-iie avatar Apr 23 '23 07:04 pengwei-iie