Segment-and-Track-Anything
Segment-and-Track-Anything copied to clipboard
An open-source project dedicated to tracking and segmenting any objects in videos, either automatically or interactively. The primary algorithms utilized include the Segment Anything Model (SAM) for k...

Is it possible for this project to be tested on video segmentation datasets (YoutubeVIS)? What are the main difficulties: SAM not only segments instances, but also segments backgrounds? Is the...
Do you think that prompted frames (e.g. to fix drift) could be dinamically added in the long term memory as reference frame? Or we could add this as an explicit...
I tried to export trackID derived by Seg-Track and got many errors. I found that there are no codes to deal with the object disappearance. https://github.com/z-x-yang/Segment-and-Track-Anything/blob/709cf2ad5ff53811f244ee19be3a8ee55290ebfb/seg_track_anything.py#L107-L117 I think Seg-Track, as...
Can we control SAM/Deaotl final input resolution from the UX/params? Can we enable Gradio zooming in the UX? Sometimes it is hard to click some fine details.
Is it convenient to use GroundingDINO to provide bbox and do next step with your current code?
Can you adapt the UX to respect the different aspect ratio of the input video?
Can you expose the multiple SAM segmentation candidates in the UX?
ffmpeg.error

when I run app.py,but I got a mistake ,that is "No module named 'blib2to3'". then I install "2to3" packages ,but the mistake still exist