Is it possible to run realtime(10+ fps) on mobile phone?

[xueyedamo]

First，thanks for your great work! I have run it successfully on my mobile, and the performance is amazing. However, it only can get 2 fps because of my power mobile. I have tried to simplify the structure of the net and FPS get a little better. Could you help me get a better FPS just like the "抖音尬舞机". I do not know how they get the performance. Help me please.

[edvardHua]

Now it is possible in iPhone under my test model, but most of android smartphone doesn't support GPU computation which cause low performance. I still try my best to optimize it.

Later I will release more models (like hourglass) that performance better than cpm. Stay tuned.

[austingg]

maybe， we can try MACE infernece framework, which supports gpu.

[austingg]

Besides，we can use less stage such as the first 3 stage.

[edvardHua]

Actually the model (will release these two days) I test now can reach 20~50 FPS on iPhone 6s +, but the detect result is not smooth enough. I guess maybe I should use tech like tracking or lstm. I still investigate.

[edvardHua]

Pls check rep for using GPU on android. Now it can reach 50+ FPS on Snapdragon 845. 😁

[youngcadam]

Shouldn't you be able to get similar performance on iPhone with the A12's neural engine? Not sure if there are more updated methods for pose estimation on iPhone but I'm trying to get smooth results on ios.