How can i detect hand is up or down.?

[adarmawan117]

I tried to check i (up) and j (down) gestures, but the result always (i). . gesture of i . Gesture of j . . Please, suggest me

[laisuki1109]

hi, thank you for asking, this android is not support to check the direction of hand, because the used model Mediapipe can only detect the gesture in one direction (for example: gesture i).

The methodology of using this model is : 1.) turn the picture to the positive direction (like gesture i) by palm coordinates 2.) and then detect 21 hand joints to guess the gesture.

Therefore, this model will detected that gesture i == gesture j

What you need to do is to record the transformed angle in step i and add detection after step 2, to recognise same hand pose with different directions.

[adarmawan117]

What you mean with "record the transformed angle in step i".?

[laisuki1109]

What you mean with "record the transformed angle in step i".?

what I mean is to mark the angle transformed in step one. Because the model will turn all the test bitmap to positive direction with palm coordinates.

you can find the sensor orientation ate line 122 in DetectorActivity.java

You might need to compare the sensor orientation with the camera direction

[adarmawan117]

What you mean with "record the transformed angle in step i".?

what I mean is to mark the angle transformed in step one. Because the model will turn all the test bitmap to positive direction with palm coordinates.

you can find the sensor orientation ate line 122 in DetectorActivity.java

You might need to compare the sensor orientation with the camera direction

Please, can you give me a example code for comparing the sensor orientation,?