webxr-hand-input icon indicating copy to clipboard operation
webxr-hand-input copied to clipboard

Dealing with atypical numbers of fingers

Open Manishearth opened this issue 4 years ago • 3 comments

Not everyone has the same number of fingers. What can we do to make things work well for these users? We should probably solicit input from affected users when tackling this problem.

Some concrete concerns:

  • We should enable applications to be written such that users may get a hand representation faithful to their own, if they so wish
  • It should be possible for applications using gestures to be able to support fallback gestures in cases where some fingers are missing

Some of this probably requires devices/backend APIs to expose more information (or configurability at the OS layer). Filing the issue now as a tracking issue so that we don't forget about it.

(h/t @mcclure for reminding me of this and pointing out specific concerns)

Manishearth avatar Jan 16 '20 06:01 Manishearth

There are other ways that a hand can vary, such as atypical finger lengths. It may be desirable to normalize the hand model to avoid fingerprinting; however, this would require constraints to be defined (eg, optimize finger tip positions.. optimize finger angles regardless of length)

Generally, we may wish to strike a balance between user choice of physical representation, accessibility, and fingerprinting.

kearwood avatar Feb 05 '20 17:02 kearwood

Another use case: people with one or more partial fingers.

rkochman avatar Feb 05 '20 19:02 rkochman

Generally, we may wish to strike a balance between user choice of physical representation, accessibility, and fingerprinting.

Yeah, I imagine that a lot of this would be surfaced in the form of UA configurability.

Manishearth avatar Feb 05 '20 19:02 Manishearth