real-world-geometry icon indicating copy to clipboard operation
real-world-geometry copied to clipboard

Add support for 3D geometry

Open cabanier opened this issue 1 year ago • 10 comments

Quest room setup allows for the creation of 3D objects and we'd like to expose those like we do for planes. For future proofing, I think we can expose them as meshes (like we do for planes). I believe Hololens already has APIs to expose the real world this way.

Should we extend the plane API or create a new mesh API that is almost identical to the plane one?

cabanier avatar Mar 20 '23 23:03 cabanier

/agenda

AdaRoseCannon avatar Mar 21 '23 09:03 AdaRoseCannon

Babylon native has support for a similar feature that uses the same API as the plane API - https://github.com/BabylonJS/Babylon.js/blob/master/packages/dev/core/src/XR/features/WebXRMeshDetector.ts

It also extends the webxr types to support the feature - https://github.com/BabylonJS/Babylon.js/blob/master/packages/dev/core/src/LibDeclarations/webxr.nativeextensions.d.ts#L29

It is not supported on the web, of course, but it will be great to have an API to make it work in Web as well.

RaananW avatar Mar 21 '23 16:03 RaananW

That's very cool that you already implemented this natively. I made a quick replace of plane with mesh and created this spec proposal: https://cabanier.github.io/real-world-geometry/mesh-detection.html It seems to match closely what you implemented.

cabanier avatar Mar 21 '23 18:03 cabanier

It seemed that there were no objections during the meeting. @AdaRoseCannon What do I need to do to make this an official spec/repository?

cabanier avatar Apr 04 '23 18:04 cabanier

@AdaRoseCannon @himorin Can one of you make a repository for WebXR Meshes?

cabanier avatar Apr 18 '23 17:04 cabanier

https://cabanier.github.io/real-world-geometry/mesh-detection.html contains an initial proposal. During the weekly call, we discussed that an author might like to know if this API returns a fine mesh.

/facetoface discuss WebXR Mesh proposal. Do we need to flag if a mesh is fine/precise?

cabanier avatar Apr 18 '23 17:04 cabanier

@cabanier we already made it :)

https://github.com/immersive-web/real-world-meshing

AdaRoseCannon avatar Apr 18 '23 18:04 AdaRoseCannon

@cabanier we already made it :)

Thanks! I moved the spec to https://immersive-web.github.io/real-world-meshing/mesh-detection.html

cabanier avatar Apr 25 '23 17:04 cabanier

@cabanier we already made it :)

Thanks! I moved the spec to https://immersive-web.github.io/real-world-meshing/mesh-detection.html

oh, I've set ghaction working with index.bs. do we want to have filename other than that?

himorin avatar Apr 25 '23 17:04 himorin

ah. Sure, I will update the repo with that filename.

cabanier avatar Apr 25 '23 17:04 cabanier