instant-ngp icon indicating copy to clipboard operation
instant-ngp copied to clipboard

Published 20 hours ago • verified publisher icon NVlabs

Plugin for Game engine such as Unity

Open keli95566 opened this issue 2 years ago • 5 comments

Does anyone have an idea how to use this amazing toolkit in the Unity game engine? Such that we could view real-time training results via openXR/steamVR.

keli95566 avatar Jun 21 '22 19:06 keli95566

ward

MS-2 avatar Jun 21 '22 19:06 MS-2

I just discovered this really cool project from a few years ago called Colibri VR that uses colmap, so i input one of my outpupts from instant-ngp, it's a little wonky, but it seems like it's definitely possible. (i've never used unity before). Apparently the goal is to be able to put together a scene from real photographs (or video turned into photos in my case) and be able to move around in VR.

Interestingly, I discovered this while trying to figure out how to get instant-ngp and ffmpeg to render a second camera nudged slightly to the right(or left) for stereoscopic video, which would also be very cool.

Byronius7X avatar Jul 07 '22 03:07 Byronius7X

I am an Unreal Engine user but VDB export will work for both engine. We have vdb plugin. I think you guys also have that.

ffreality avatar Jul 17 '22 01:07 ffreality

@ffreality thanks a lot for the response. Is there a VDB export option from instant-ngp? I see that testbed.exe is only responsible for training and rendering..

keli95566 avatar Jul 18 '22 11:07 keli95566

@keli95566 nope, not currently but some users says there are some ways to implement it.

ffreality avatar Jul 21 '22 21:07 ffreality