yurinoviello

Same issue

Same issue on Nvidia L4 x 2 Command: ```accelerate launch -m lm_eval --model hf --model_args pretrained=meta-llama/Llama-2-7b-chat-hf --tasks arc_challenge --batch_size 1 --num_fewshot=25``` Accelerate conf: ``` compute_environment: LOCAL_MACHINE debug: false distributed_type: FSDP...

> Same issue on Nvidia L4 x 2 > > Command: `accelerate launch -m lm_eval --model hf --model_args pretrained=meta-llama/Llama-2-7b-chat-hf --tasks arc_challenge --batch_size 1 --num_fewshot=25` > > Accelerate conf: > >...