sentis-samples icon indicating copy to clipboard operation
sentis-samples copied to clipboard

Object Detection and Image Segmentation

Open RossMelbourne opened this issue 2 years ago • 5 comments

I was wondering if Unity plans on releasing samples showing how to do Object Detection and Image Segmentation using a normal camera or even a webcam? I know this has been done by people using Barracuda so I am assuming it will work even better with Sensis. Thank you for all the great new features in Unity.

RossMelbourne avatar Oct 06 '23 21:10 RossMelbourne

Thank you for the suggestion. This is known internally as Task 258

Hi we have some new models on Hugging Face.. This includes an object detection model YOLOv7 and a face detection using a camera (blaze-face). We will be adding more including segmentation soon. Stay tuned.

elephantpanda avatar Jan 28 '24 08:01 elephantpanda

Hello @pauldog , are you referring to this example : https://huggingface.co/unity/sentis-YOLOv8n , As there is no YOLOv7, More over it doesn't take the direct camera feed rather the static video. Please let me know if I misinterpret it.

rawatsaurabh avatar Mar 16 '24 15:03 rawatsaurabh

There is this one too: https://huggingface.co/unity/sentis-yolotinyv7

Yes feel free to implement the camera feed yourself.

elephantpanda avatar Mar 16 '24 16:03 elephantpanda

Hi, I tried to get an image segmentation which works fine with Barracuda to work with Sentis, but with very little luck :( I wanted to use the "109_Selfie_Segmentation" from PINTO_model_zoo, which works with barracuda, but not with Sentis. Is this a problem with model compatibility? What can I do to get it working?

RC137 avatar Apr 16 '24 12:04 RC137