depthai-experiments icon indicating copy to clipboard operation
depthai-experiments copied to clipboard

Neural Compute Engine: Maximum Utilization and Framerate

Open JojoDevel opened this issue 2 years ago • 1 comments

I just read here that the Myriad X VPU has 2 Neural Compute Engines. Is that fully utilized with a single neural network (like object detection with Yolov5)?

Can I see the utilization somewhere?

Would it make sense to launch two yolov5 networks and alternately feed a camera image to the first or the second instance? Could that increase the maximum framerate to execute yolov5?

JojoDevel avatar Mar 27 '22 15:03 JojoDevel

Hello @JojoDevel , NeuralNetwork node actually has nn.setNumInferenceThreads(threads) and nn.setNumNCEPerInferenceThread(nceNum) (NCE=Neural Compute Engine) functions, so you don't need to run your NN (yolov5) twice, you can just set these 2 functions. Both of these functions have 0 = AUTO value by default. Thanks, Erik

Erol444 avatar Mar 28 '22 10:03 Erol444