OpenVINO-YoloV3 icon indicating copy to clipboard operation
OpenVINO-YoloV3 copied to clipboard

I get the ~same FPS by using -numncs 1 and -numncs 2

Open AlexeyAB opened this issue 4 years ago • 5 comments

I should get 2x more FPS by using -numncs, isn't it?

[Required] Custom device Atom CPU + 2 x MyriadX (VPU) via mini-PCI-express

[Required] Your device's CPU architecture x86_64 Intel Atom E3845

[Required] Ubuntu16.04.6 LTS (OpenVINO 2019.1.144)

[Required] Details of the work you did before the problem occurred:
I get the ~same FPS by using -numncs 1 and -numncs 2.

  • I get 10.7 FPS by using -numncs 1 image

  • And I get 10.3 FPS by using -numncs 2 image


By running multistick_cpp example from OpenVINO, I get this message: image

python_ncs

AlexeyAB avatar Jul 08 '19 14:07 AlexeyAB

@AlexeyAB Sorry for late reply.

(1) Python script Are you using USB 3.0? Accelerator devices such as NCS2 and Google Edge TPU Accelerator do not perform well with USB 2.0. By the way, if you are using an x86 CPU, using a CPU is much faster than using NCS2.

(2) C++ script This is a modified version of Intel's sample program. Intel's program does not work properly, such as multi stick. I have not performed accurate tuning for C ++ programs.

OpenVINO 2019 R2 was released the other day. Multi-stick API level support and the ability to measure the stick's internal temperature have been added. I will update YoloV3's repository to correspond to the latest API after a while.

PINTO0309 avatar Jul 28 '19 13:07 PINTO0309

@PINTO0309 Hi,

  1. I use 2 x Myriad X chips via mini-PCI-express. But I get the same ~10 FPS with 1 x Myriad X and with 2 x Myriad X chips. I use your python scipt with -numncs 1 and -numncs 2.

  2. I modified C++ OpenVINO example by myself and got for yolov3.cfg:

  • sync - with 1 x Myriad X: 2.3 FPS
  • async - with 1 x Myriad X: 4.2 FPS
  • async - with 2 x Myriad X: 6.3 FPS - I think it can be improved up to 8 FPS.

AlexeyAB avatar Jul 28 '19 14:07 AlexeyAB

Hi, @AlexeyAB

My Python program is waiting for 7 seconds to initialize one NCS2. In other words, the first NCS2 takes effect after 7 seconds and the second NCS2 takes effect after 14 seconds. Is the performance the same even if you wait 14 seconds?

Hmmm... I do not know where the bottleneck is...

PINTO0309 avatar Jul 28 '19 14:07 PINTO0309

@PINTO0309 Yes, even if I wait 60 seconds, FPS is the same.

AlexeyAB avatar Jul 28 '19 20:07 AlexeyAB

I have the same problem too :(

EscVM avatar Oct 18 '19 12:10 EscVM