HoloLens2-ResearchMode-Unity icon indicating copy to clipboard operation
HoloLens2-ResearchMode-Unity copied to clipboard

Get raw RGB Frame

Open pallavimohansaab opened this issue 4 years ago • 4 comments

Is it possible to get the raw RGB/PV camera frames through this .dll?

In the original C++ app, it saves the RGB frames along with the AHAT results, and I'm looking to extract the raw RGB frame in Unity as well. However, I didn't find a suitable function in the built .dll. Any pointers?

Thanks in advance!

pallavimohansaab avatar Mar 10 '21 02:03 pallavimohansaab

You don't need to enable research mode to access the PV camera. You can check this script how to obtain and visualize PV camera frames in Unity.

petergu684 avatar Mar 23 '21 17:03 petergu684

Hello, I try to obtain a pv image based on the point cloud to get a color point cloud. I use PhotoCapture directly obtains the pv image in unity/C#, there is no problem when this method is run alone. However, when I used PhotoCapture and research mode at the same time, some abnormalities occurred. The point cloud was continuously acquired, and the acquisition of the pv image was controlled by the button. When four to five pv images are obtained, the program exits directly. And when I run the program again, the research mode API seems to be unable to obtain the deep point cloud information, and I must restart hololens. Perhaps this is a conflict between the pv camera and the depth camera? Is there any possible reason or solution? Any help would be greatly appreciated.

kaiwu119 avatar Apr 22 '21 09:04 kaiwu119

I don't think PhotoCapture is designed for video streaming tasks as its name indicates. This Project has the implementation to map RGB frame to point cloud on HoloLens 1. Probably that would be useful to you.

petergu684 avatar May 15 '21 05:05 petergu684

I don't think PhotoCapture is designed for video streaming tasks as its name indicates. This Project has the implementation to map RGB frame to point cloud on HoloLens 1. Probably that would be useful to you.

Hello,there are any Hololens2 solutions to achieve video sreaming tasks in unity ?

shoukailiang avatar Jan 07 '22 11:01 shoukailiang