It's useless to inference when batchsize is not 1

[Egozjuer]

It's strange when I set batchsize more than 1,such as 7,the inference time Increased seven times，It seems to be executed serially，the model is yolov3

[enazoe]

bacause the gpu compute capabilities is already saturated when the batch is 1