How to evaluate model using multi-gpu?

[lqniunjunlper]

When using llm-foundry for model evaluation, multi-gpu mode does not work.

The source code is here: https://github.com/mlfoundations/open_lm/blob/main/eval/eval_openlm_ckpt.py