Is there any way to achieve ARCore-like functions with just mediapipe and opengl or related 3D rendering engines in Android with gradle？

[ouyangpeng]

I found that it is easy to use ARCore to achieve AR effects, but ARCore can only be used in some machine, not my android device.

so I plan to use Mediapipe to obtain some functions such as face 3D mesh, but how to combine Mediapipe and OpenGL to achieve AR functions?

It's not clear, mediapipe has a Face Effect Example, but the code is compiled with Bazel and I can't understand it. I wonder if there is an example project compiled with gradle? So I can refer to how to achieve.

Thank you very much !

[sureshdagooglecom]

Hi @ouyangpeng , Unity is not officially supported by MediaPipe yet. Assuming this MediaPipeUnityPlugin could be more helpful. Thank you!

[ouyangpeng]

Hi @ouyangpeng , Unity is not officially supported by MediaPipe yet. Assuming this MediaPipeUnityPlugin could be more helpful. Thank you!

Thank you , I don't mean to use the combination of Unity and MediaPipe, but consider using MediaPipe combined with Filament or other 3D rendering engines to achieve an effect similar to ARCore combined with Filament, such as this case Scenform-android, I wonder if there is a related sample code for MediaPipe combined with Filament?

[kostyaby]

Hey @ouyangpeng,

You're right that ARCore has a significantly simpler mobile API/SDK for AR. Unfortunately, there're very limited resources to build/maintain a similar one for MediaPipe. At this point, it's DIY-style API: we provide working demos using Bazel, but there're no resources to wrap them further into Android/iOS SDKs - so it's up to the users to complete that task. Sorry about that, but that's kind of the way it is at the moment :/

[google-ml-butler[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you.

[google-ml-butler[bot]]

Closing as stale. Please reopen if you'd like to work on this further.

[google-ml-butler[bot]]

Are you satisfied with the resolution of your issue? Yes No