VTuber-Python-Unity icon indicating copy to clipboard operation
VTuber-Python-Unity copied to clipboard

barracuda facemesh & other model

Open ghost opened this issue 2 years ago • 1 comments

Hi @mmmmmm44 ,

Hope you are all well !

I was wondering how complicated it would be to re-use https://github.com/keijiro/FaceMeshBarracuda with your project.

Do you think it is possible ? Can you help me do so ?

Thanks for any insights or inputs on that.

Cheers, Luc Michalski

ghost avatar Sep 23 '21 22:09 ghost

Hi Luc,

I think it won't be that complicated as the project is just importing the models used in Facemesh to unity, so that the detection is run in unity directly instead of creating a new TCP connection everytime.

I think the major stuffs to do are:

  1. Convert most of the python code to unity (Edit: have to find whether there is opencv package for unity. Maybe available in unity asset store)
  2. Find out how to enable camera feature directly in Unity (think there are tutorials available online) (cuz not that familiar with Unity development)

I don't have much free time to follow this project until the Christmas holidays/ luner new year holidays. So hardy does development be made during these months.

Btw, thank you for ur suggestions. I will look into them in the future. If able to do so, I will upload a new project in github.

Cheers, mmmmmm44

mmmmmm44 avatar Sep 28 '21 01:09 mmmmmm44