mixed-reality-extension-sdk icon indicating copy to clipboard operation
mixed-reality-extension-sdk copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Feature Requeset: Respond to/communicate tracking loss for hands/controllers

Open scm2217 opened this issue 5 years ago • 4 comments

It would be nice to be able to tell when hand tracking is lost and have direct access to hand mesh collision.

scm2217 avatar Aug 29 '19 18:08 scm2217

Hand tracking is a concept unknown to the MRE SDK. Can you elaborate?

eanders-ms avatar Aug 29 '19 18:08 eanders-ms

The attachment system is able to attach to a game object that is controlled by MRTK that represents the hand. I modified this game object to disable itself when hand tracking is lost, but the MRE is unable to receieve this change in state from Unity. The "enabledAndActive" flag seems to only get updated when changed in the MRE. This results in undesired behavior as I have a event that triggers when a hand has a specific rotation.

scm2217 avatar Aug 29 '19 22:08 scm2217

Changed title to specify the exact request to detect and handle "loss of tracking".

sorenhan avatar Sep 09 '20 02:09 sorenhan

As mentioned earlier, the MRE itself doesn't know about hand/head positions. This should probably be implemented completely client-side in the host app, just not sending transforms over when parent is disabled?

sorenhan avatar Sep 09 '20 02:09 sorenhan