yolov7 icon indicating copy to clipboard operation
yolov7 copied to clipboard

Add grid concat and fuse such operators

Open triple-Mu opened this issue 1 year ago • 2 comments

Now we can export concat all anchors outputs in flag --grid ! If we use --grid only, we will export an onnx with one concat output. If we use --grid and --end2end, we will export an onnx with nms. And now the anchor generate process is simplied as the picture shown! yolov7-before-now It will speed up in onnxruntime and tensorrt backends!

triple-Mu avatar Aug 01 '22 15:08 triple-Mu

Also do you have any test, does it work faster and still correctly?

AlexeyAB avatar Aug 01 '22 21:08 AlexeyAB

image @AlexeyAB I have test in batch=32 in cpu onnxruntime. Two results are the same. This pr speed up 2-3%. If we use huge batchsize, maybe speed up more!

triple-Mu avatar Aug 02 '22 08:08 triple-Mu