Utilize the camera on DK2

[noname22]

[shinyquagsire23]

This one might be a bit more difficult considering that it involves motion tracking. It might be good to start grabbing images off of it and get the distance and such based on the size/spread of the dots in relation to the image. Once the distance is gotten, then you can track the entire "box" in an x/y space and apply manipulation based on that.

A few issues might be had if the box goes off the camera, and how it should be handled if that occurs. IIRC the lense is fairly wide so it shouldn't be too much of an issue, but it might be something to keep in mind.

[Fredz66]

You may have a look at this video where Dov Katz explains how positional tracking is implemented in the Oculus SDK : https://www.youtube.com/watch?v=dxbh-TM5yNc#t=1634

I guess OpenCV should help there.

[Mhnix]

I started researching how to go about this issue, and among other things I found https://github.com/uzh-rpg/rpg_monocular_pose_estimator which could be used/modified to track the DK2.

However, it seems that the infrared lights on the HMD does not light up automatically? I tried filming the HMD with the camera while it was tracking rotation (using openhmd), but no leds showed... If someone can figure out how to turn on the leds, the positional tracking part will be relatively easy I think.

[Fredz66]

If you watch the video I posted you'll see that implementing positional tracking will be very far from being an easy task. I mean implementing it reliably with good precision/accuracy and low latency.

[Mhnix]

Yes, implementing something that works is relatively easy, but implementing something that works as well as the official implementation will of course be harder. But as long as you have a starting point the rest is just an iterative process to get better precision/accuracy and lower latency.

[shinyquagsire23]

It seems some research has gone into the DK2's positional tracking and a few people managed to activate the LEDs on the DK2 and get some stuff done with them. Might help a bit with positional tracking if it is still planned for OpenHMD.

Link and also this

Second link has some solid information on activating the LEDs, as well as some other stuff. First one is pretty good as well.

[noname22]

Yes, some of them hang out in #openhmd on freenode now :)

[demonixis]

Hi, I don't know if the work has started on this side but I have found a very nice article about the LEDs of the DK2. I hope it can help.