question about inference time on batchsize 1 or multiple batchsizes

[harrylin-hyl]

I use CSPDarknet as the backbone of my detection on mmdetection, but the inference time of CSPDarknet is slower than Darknet when batchsize is 1. However, when batchsize increases 8 or more, the inference time is quicker than Darknet. Is this normal? or something wrong?

Thanks!