surya
surya copied to clipboard
Automatic batch size using accelerate
It would be great to add an option to select batch size automatically using accelerate find_executable_batch_size function:
https://huggingface.co/docs/accelerate/main/en/package_reference/utilities#accelerate.find_executable_batch_size