MixedRealityCompanionKit icon indicating copy to clipboard operation
MixedRealityCompanionKit copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Access front camera in RemotingHostSample

Open LDeakin opened this issue 8 years ago • 4 comments

I would like to access the front camera stream (low latency raw, not mixed reality) for object/marker detection while simultaneously doing remote rendering (as in RemotingHostSample). I can access the camera with the MixedRemoteViewCompositor viewer , but then I am no longer running the Holographic Remoting Player app and can't remotely render. Is there a way to access the camera and remotely render simultaneously?

Ideally, the Holographic Remoting Player app should provide access to the camera stream.

LDeakin avatar Apr 24 '17 04:04 LDeakin

Hi @LDeakin, I am also trying to do the same thing and according to the answer on this post that is not possible https://forums.hololens.com/discussion/comment/14545#Comment_14545

In case you would find a solution for this or via another solution (to synch and transmit the holograms from the desktop to the Hololens, and jointly do processing on the Hololens) it would be great to know! I will keep you posted if I find a solution too

araujokth avatar Apr 24 '17 10:04 araujokth

Any comment from MS devs on this one? @davidkline-ms @jwittner As far as I am aware the same limitation applies to Unity/Vuforia too since they also depend on the Remoting Player. This is a major blocker for any app that needs expensive rendering and computer vision.

LDeakin avatar May 18 '17 02:05 LDeakin

I believe you'd have to understanding the protocol by which the remote rendering works and implement that into your own HoloLens application in order to extend the capabilities beyond that provided by the Remoting Player or to combine it with that of the MixedRemoteViewCompositor.

Admittedly though I'm fairly unfamiliar with the MixedRemoteViewCompositor.

jwittner avatar May 18 '17 21:05 jwittner

So, I am now trying to recreate the functionality of the Holographic Remoting Player app.

I have managed to get Connect() from IHolographicStreamerServer in HolographicStreamer.h firing. A connection with the RemotingHostSample seems to be established. But, how do I get CameraAdded firing in RemotingHostSample. Any suggestions?

Could The Holographic Remoting Player app be open-sourced?

LDeakin avatar May 29 '17 03:05 LDeakin