inference icon indicating copy to clipboard operation
inference copied to clipboard

Published 20 hours ago • verified publisher icon mlcommons

How to set batch size with Bert

Open JunxiChhen opened this issue 1 year ago • 1 comments

Hi, I am trying to do inference with Bert. However, I don't find any API to set batch size in run.py. Could you pls. help me with that? Appreciate a lot.

JunxiChhen avatar Aug 10 '22 00:08 JunxiChhen

@pgmpablo157321

rnaidu02 avatar Oct 11 '22 15:10 rnaidu02