arcore-depth-lab icon indicating copy to clipboard operation
arcore-depth-lab copied to clipboard

Published 20 hours ago • verified publisher icon googlesamples

Continuous evironment mesh building

Open Ademord opened this issue 3 years ago • 5 comments

hello @ruofeidu, thank you for all the effort you guys put into making this repo and the research behind it. i am doing something similar to #31, and I am looking at KinectFusion and some SLAM alternative.

One question though, how could I reuse the primitives that you have for obtaining the depth information and the point cloud? I have found resources online that i have to write my own shaders etc, and was wondering if there as an API I could use (I have not tried or used the ARCore Raw Depth API, could you maybe explain what is possible and what is not possible with it? what did you have to do on your own that I could maybe reuse from your work?

Ademord avatar Jun 17 '21 11:06 Ademord

Hi Franco,

Sorry that I'm out of office this week on vacation; I'll try to revisit next Tuesday. There is a raw point cloud scene with main API and script in 1) (Using AR Foundation) https://github.com/googlesamples/arcore-depth-lab/blob/master/Assets/ARRealismDemos/PointCloud/Scripts/RawPointCloudBlender.cs 2) https://github.com/googlesamples/arcore-depth-lab/blob/arcore_unity_sdk/Assets/ARRealismDemos/PointCloud/Scripts/RawPointCloudBlender.cs

Only very basic algorithm is implemented, and I look forward to real-time KinectFusion with it :D

Cheers, Ruofei

ruofeidu avatar Jun 18 '21 00:06 ruofeidu

Hi @ruofeidu and thank you for your feedback! I posted in the unity forums to figure out how to use a normal game camera with the ARkit.. I assume its made for only iphones ? And i have no idea how to access the depth textures as of today from a normal game cam. Enjoy your holidays!!

Ademord avatar Jun 18 '21 00:06 Ademord

Thank you! BTW, this repo is only targeted at Android and ARCore :) Not for iPhone as stated in the README.md

ruofeidu avatar Jun 18 '21 01:06 ruofeidu

i see this repo is quite abandoned but i still hope this feature will be made by someone in somewhat near future

Darkar25 avatar Mar 01 '22 20:03 Darkar25

Hi Darkar25,

I won't say it's abandoned - all algorithms are still working in the legacy arcore-unity-sdk branch and it's fairly straight forward to port them in other forms. For example, our recent launch of 3D portrait photo https://blog.tensorflow.org/2022/05/portrait-depth-api-turning-single-image.html?linkId=8063793 is rewrite of DepthLab 3D photo scene.

Cheers, Ruofei

ruofeidu avatar Jun 08 '22 21:06 ruofeidu