surya icon indicating copy to clipboard operation
surya copied to clipboard

Automatic batch size using accelerate

Open juletx opened this issue 1 year ago • 0 comments

It would be great to add an option to select batch size automatically using accelerate find_executable_batch_size function: https://huggingface.co/docs/accelerate/main/en/package_reference/utilities#accelerate.find_executable_batch_size

juletx avatar May 09 '24 10:05 juletx