AITemplate icon indicating copy to clipboard operation
AITemplate copied to clipboard
verified publisher icon facebookincubator

How we can run stable diffusion models as parallel at the same time?

Open mzeynali opened this issue 2 years ago • 0 comments

Hi guys, I compiled the SD model with batch size = 1 and achieve inference time = 2 sec. Then I compiled the same model with Batch size = 4, I achieve inference time = 10 sec for 4 images. This shows us the models don't process as parallel and do sequential way. Why? How I can solve the problem?

mzeynali avatar Jun 28 '23 11:06 mzeynali