offsite-tuning icon indicating copy to clipboard operation
offsite-tuning copied to clipboard

How to run distributed evaluation for big models used in this paper?

Open sanyalsunny111 opened this issue 1 year ago • 0 comments

It seems all the eval for LLMs are done using 1 GPUs can you suggest ways to run distributed eval?

sanyalsunny111 avatar Feb 28 '23 20:02 sanyalsunny111