TLabWebViewVR icon indicating copy to clipboard operation
TLabWebViewVR copied to clipboard

Integrating Meta-All-in-One SDK

Open varnit-mittal opened this issue 8 months ago • 3 comments

Hi,

Could you please help me with integrating Meta-All-in-One SDK head tracker with this project. I want to calibrate the scene with my head and eyes and then I am planning to collect data in order to calculate the cognitive load using some sample surveys.

varnit-mittal avatar Mar 31 '25 13:03 varnit-mittal

Hi @varnit-mittal, thanks for the question (and sorry for the late reply). If possible, could you please share a bit more about what you want to do or any problems you might be facing ?

TLabAltoh avatar Apr 01 '25 15:04 TLabAltoh

Hi @TLabAltoh, thanks for the reply, i want to integrate head trakcer so that the web-view can rotate in the direction of my head and I also want to integrate eye tracking to calculate fixation points. Right now, i am using hand tracking scene in your project.

I would really appreciate it if you could help me out with this.

varnit-mittal avatar Apr 01 '25 22:04 varnit-mittal

Thanks for detailed info. I'm using Quest 2 and it doesn't support eye tracking so maybe I couldn't be helpful about eye tracking (As far as I know, eye tracking is only supported on the Quest Pro. Maybe you use it?). But about rotate WebView towards HMD (Head Mount Display), it could be implemented with this API.

//
// Note that this code was written as a sample and has not been verified for actual operation. For reference only.
//

public Transform head;   // HMD's transform
public Transform panel;  // WebView prefab's transform

void RotatePanelTowardHead() {
    // This code just rotates WebView prefab to HDM
    panel.rotation = Quaternion.LookRotation((head.position-panel.position).normalized, Vector3.up);
}

void Update() {
    // 
    RotatePanelTowardHead();
}

This is a very simple API, but you'll need to write your own C# script to customise the project for your use case, as this example repository doesn't cover the situation as you intended.

Also, maybe I haven't fully understood what you want to implement with eye tracking (maybe you want to float the WebView in front of the eye or head?). If you need more support or advice, I would appreciate a diagram (or image) of what you want to implement.

TLabAltoh avatar Apr 02 '25 15:04 TLabAltoh