Camera image of Hololens2 is not be displayed

[Sakitakazawa]

Hi. I want to use OpenCVForUnity with Hololens2. It works well in unity editor but when built to Hololens2, camera image of Hololens2 is not be displayed. (I want to try Comic filter Example.) I set up according to Readme of this, OpenCVForUnity. How can I use Hololens2's camera with OpenCVForUnity?? In there any special procedure when using Hololens2, not Hololens??

using version: Hololens2 Unity 2019.4.23f1 Visual Studio 2019 OpenCVForUnity 2.4.4

[felixvh]

Did you make it work? Is OpenCVForUnity at all compatible with HoloLens 2?

[EnoxSoftware]

Hi, Felix

Unfortunately, I don't have Hololens2 at hand and haven't tried it, but this thread already has a way to make my example work with Hololens2. https://github.com/EnoxSoftware/HoloLensWithOpenCVForUnityExample/issues/29

Best regards, Enox Software

[fmtibaa]

Hi, i've got the same issue i cannot display anything when i use OpenCVForUnity in my scripts, i've just used the function that converts a texture to a matrix and there is nothing that is displayed on my HoloLens2 but in the editor everything seems to be Ok.

is there any solution to use OpenCVForUnity on HoloLens 2 ?

[felixvh]

I don't knwo what exactly you are doing in your application but for me I could use OpenCVForUnity in my HoloLens 2 applications. But I only used the blob detection algorithm and the Kalman filter provided by the library.

[fmtibaa]

Thanks for your response, i want just to use some filters like sobel filters and outline detection on the video stream of the HoloLens 2 webcam. i just want to know how to retreive the projection matrix and the camera to world mattix of the camera, if you have any idea that could help tell me.

Thanks ! best regards

[felixvh]

I haven't really worked with the webcam so far. Just with the depth camera provided by the research mode. But I think this might be a good starting point for you: https://docs.microsoft.com/en-us/windows/mixed-reality/develop/unity/locatable-camera-in-unity