opencompass icon indicating copy to clipboard operation
opencompass copied to clipboard

Published 20 hours ago • verified publisher icon open-compass

Switch to python runner for single GPU

Open xu-song opened this issue 7 months ago • 0 comments

Motivation

There is no need to use torchrun for single GPU inference. Besides, python runner is more friendly for debugging. The debugging snippet is as follows https://github.com/open-compass/opencompass/blob/889e7e11409d83fe312ecc7d7f0ed8861a84cc92/opencompass/runners/local.py#L116-L131

xu-song avatar Jul 11 '24 08:07 xu-song