what does parameter max-inference-batch-size truly mean?

[whdcwsj]

I don't clearly understand what the parameter max-inference-batch-size means， What is the relationship between it and batch_size?

[Sleepychord]

the batch size fed into the networks when generating. If batch size is very large, max-inference-batch-size defined how much times to divide the generation.