react-native-arkit
react-native-arkit copied to clipboard
react-native-ar
Face tracking
I know ARKit has face tracking https://developer.apple.com/videos/play/fall2017/601/ I was wondering if you plan to implement such a feature or you decided not to (and why)
@G3z I don't have an iphoneX to try it out, but there is nothing that would prevent an implementation. PRs would be welcome!
It looks not so complicated: https://developer.apple.com/documentation/arkit/arfacetrackingconfiguration
I will soon implement the newer Anchor types like Image or vertical planes (coming with arkit 1.5 on current ios beta), after that its probably easier to add support for ARFaceAnchor
@G3z I am adding new anchor-types and it should be easier now to add facetracking: https://github.com/HippoAR/react-native-arkit/pull/155/files#diff-f21b481ab0f573fb47650585ffa63fe7R510
We probably just need to add a new property to the <ARKit />-component to enable facetracking
@evezzaro it's not planned for the moment from my side. PR's are highly encouraged!
I'm using MLKit for this now... But it would be really cool if this did work. A lot faster, too 😄
@RWOverdijk hi! I am curious that we can make AR face mask just like Instagram, with this awesome library. Or have you already done with something else?
thanks for reply, @RWOverdijk do you think we have possibility on react native? cause my app is written in RN currently and just is wanting to add, AR - face mask function 😊
I don't know haha. It'd probably have to be built. Maybe someone else has an answer! :)
unfortunatly, this package is no longer maintained. I know that, because i maintained it ;-)
Problem was that i had no project to use it and android / arcore version never happened (or it did happen, but they decided to fork did not merge into this package here).
you might try https://github.com/viromedia/viro/ which supports both ios and android, but it also staled a bit.
i think the AR on react-native chapter is not closed yet, but currently, its in limbo.
I would love if someone would pick up the work here or on viro. It's actually not that hard.
thanks for information, it was oasis for me. @macrozone so, what i want to archieve is the AR-face mask functionality just like one in Snapshot or Instagram, I see many stars on this project( 1.6K ), but not sure my goal is doable with this library. any answer for me?
@HappyCodingLover the library here received its last update 3 years ago. that time, Arkit had no support yet for face recognition or similar. So the answer is no, unfortunatly
@HappyCodingLover having said that, i did not read my own comment from 2018...
edit: i had the impression that it would not be that hard to implement in the library, but i am far far away from that topic, but i encourage anyone to try adding it to this library. I had great fun doing that back then.
I
@macrozone clear, so now, my possible solution should be found in Viro do u know if Viro supports face mask?
@HappyCodingLover I would ask it on that repo instead. Or try building your own! (it really is fun and there are plenty of tutorials for the native side of things).
@RWOverdijk yeap, I will try and let you know if I make something cool. thanks for your guidance
Hey @macrozone there are some pretty serious PRs open and waiting review ( worldmap sharing, some rotation helpers and others like QR codes being able to added during runtime )
Any way you would think about giving myself and @JackSoby collaborator to start bringing some of those in ? I think people would add things like face detection if not such big PRs just sitting there.
@code-matt i added you as admin to the repo!
i am unsure who has admin right on the npm repo though, let' me have a quick look...
i am currently unsue who has admin right on the npm organisation, unfortunatly, its not me, i am just member. I am not sure if i can reach the other contributors.
@gtfargo you seem to be member of hippAr. current admin on npm are zehaoli and jacy, can you reach these guyes?
@code-matt in the worst case you might need to create a new package in npm, but i guess that is not that dramatic. Make sure that you have enough people with admin rights there...
@macrozone Okay, will just create a new one if it comes down to that.
I am not seeing the ability to merge requests still though. Not that I would now, need to look some of the recent PRs over with @JackSoby
@code-matt you have to accept the invitation probably, thats sometimes a bit hidden in github
Hey @code-matt @macrozone @JackSoby, sorry for bumping this again, but I really want to use this library and have currently no idea what‘s the status. Is this package maintained, was it forked, and what eventually happened with RN AR face tracking? Thanks a bunch, Dan
hi @danbachar no, its not maintained, maybe checkout https://github.com/ViroCommunity/viro/ which is still activily maintained
@danbachar If you have a PR you would like to open I would be happy to look at it
does RN have ARKit face tracking support?
I Dont believe so, but if you would like to open up a PR I would be happy to approve!