cvat icon indicating copy to clipboard operation
cvat copied to clipboard

Delete images/frames from an existing task

Open carlescarmonacalpe opened this issue 6 years ago • 27 comments

Hi,

Thank you for this amazing tools, seems really promising. I'd like to suggest a new feature which is to allow to add/delete images/videos from an existing task. From my side it's really common to extend or reduce the dataset size during the development process.

Thank you for you work!

carlescarmonacalpe avatar Sep 26 '18 10:09 carlescarmonacalpe

Hi @carlescarmonacalpe ,

Why is it not possible just to create one more annotation task with new images? What is the advantage to update the same task?

nmanovic avatar Oct 01 '18 07:10 nmanovic

Hi,

The only advantage is that you don't need to modify/join the exported files If you annotate two different tasks and you need to have both annotations together to train a model.

carlescarmonacalpe avatar Oct 01 '18 12:10 carlescarmonacalpe

Hi @carlescarmonacalpe ,

If you have a good idea how to implement that please send us a PR. Our internal focus is to add stability, introduce analytics, improve UI and implement a couple of semi-automated methods to annotate data. Please let me close the issue for now but if you like implement such functionality don't hesitate to reopen it. In any case I really appreciate your involvements. Thank you very much!

nmanovic avatar Oct 03 '18 20:10 nmanovic

Probably it isn't a bad idea to treat an annotation task like a dataset (which can be extended or reduced). It is especially good if we will be able to change status of an annotation task automatically (e.g. done -> annotate). Also a couple of internal customers also requested the feature.

nmanovic avatar Jan 09 '19 08:01 nmanovic

Vitor Casadei 04:41 Hi, I used to use vatic and it exported the videos in image format. However on CVAT I can only download the labels, is that right? I've got to convert frames to images on my own?

vcasadei , at the moment you need to prepare data (at least for videos) by yourself. Internally we don't keep original data to save server disk space. When you upload data CVAT does compress images (image_quality parameter when you create an annotation task). Thus 1 frame can weight only 10-100 kilobytes. For example, an original image in png format can be several megabytes. I will submit an issue regarding that. Probably we need one more step in CVAT: prepare a dataset. Thus users can prepare data and after that download them from CVAT as is. If you can help us with such app/feature for CVAT you are welcome.

nmanovic avatar Feb 08 '19 04:02 nmanovic

The feature will be implemented only in our new UI. Thus need to move it on v1.0.0 which is expected at the end of the year.

nmanovic avatar Jul 22 '19 10:07 nmanovic

I am facing similar issue where I will have to consolidate/add additional frames with annotation and generate one single JSON file. Is there a way, I can do that?

pagujeeva avatar Nov 06 '19 20:11 pagujeeva

Hi, Is there a progress update on this feature?

illuminati945 avatar Sep 01 '20 12:09 illuminati945

Hello! Is there anything more with this? I have an extra 40 images to annotate so was hoping to just add them into my existing annotations. Cheers!

michellemul avatar Sep 24 '20 05:09 michellemul

Hi, any update on this feature? Would be extremely useful !! CVAT is great, but this definitely helps users who might have made mistakes when uploading datasets and didn't realize until after annotation. Furthermore, it is beneficial to any user who would like to continue to add to their datasets as they annotate. It makes exportation of annotations easier and more consolidated when going to train.

mrawding avatar Oct 19 '20 19:10 mrawding

@mrawding , the PR is the first step to solve the problem https://github.com/openvinotoolkit/cvat/pull/2255

nmanovic avatar Oct 20 '20 07:10 nmanovic

Hello @nmanovic and @bsekachev Does it work now? Adding images to an existing task, or merging tasks within a project.

davodogster avatar Aug 05 '21 02:08 davodogster

@davodogster

No updates on the feature. Instead of adding images to an existing task, you can move the task to a project and create another task in the project with new images. Finally, you can dump all the annotations for the project, after #3365 will be merged.

As a workaround, you can add to extra images a tag: "extra" for example. And if the annotation file contains this tag, you just ignore the image.

bsekachev avatar Aug 05 '21 11:08 bsekachev

@bsekachev Awesome, I'm looking forward to using this feature when it has been merged. Thank you

davodogster avatar Aug 16 '21 02:08 davodogster

@davodogster , it was merged already. Please use the latest development version if you want to test/use the feature.

To close the issue we are waiting ability to mark images/frames as removed in a task.

nmanovic avatar Aug 16 '21 05:08 nmanovic

@nmanovic Great, thanks. So I need to docker-compose stop, backup my annotations and then clone the latest cvat github repository and then docker-compose again ? Regards, Sam

davodogster avatar Aug 17 '21 01:08 davodogster

@davodogster , it is the fastest way.

nmanovic avatar Aug 17 '21 06:08 nmanovic

@nmanovic Hi guys, I just cloned the latest version of cvat and ran docker compose and modified the docker compose file (I notice there were some big changes to the docker compose file) see here:

image

It deployed successfully but there is no option for exporting a project as a dataset in the "Actions" tab.

image

Am I doing something wrong?

davodogster avatar Aug 18 '21 03:08 davodogster

@nmanovic Hi guys, I just cloned the latest version of cvat and ran docker compose and modified the docker compose file (I notice there were some big changes to the docker compose file) see here:

image

It deployed successfully but there is no option for exporting a project as a dataset in the "Actions" tab.

image

Am I doing something wrong?

Hi, please use Export task dataset option in the Actions tab.

Regarding orphans container - it's expected, just follow the docker suggestion and add --remove-orphans once.

azhavoro avatar Aug 18 '21 07:08 azhavoro

Hi,

That is not an option. The only option is delete. That is why I asked the question.

Cheers, Sam

Get Outlook for iOShttps://aka.ms/o0ukef


From: Andrey Zhavoronkov @.> Sent: Wednesday, August 18, 2021 7:33:56 PM To: openvinotoolkit/cvat @.> Cc: Sam Davidson @.>; Mention @.> Subject: Re: [openvinotoolkit/cvat] Add/Delete images/video to existing task (#95)

@nmanovichttps://github.com/nmanovic Hi guys, I just cloned the latest version of cvat and ran docker compose and modified the docker compose file (I notice there were some big changes to the docker compose file) see here:

[image]https://user-images.githubusercontent.com/46079516/129834211-7ef3c7a9-5c82-494c-96eb-62ac7e0f3a94.png

It deployed successfully but there is no option for exporting a project as a dataset in the "Actions" tab.

[image]https://user-images.githubusercontent.com/46079516/129834633-16b0a805-69f3-4b77-94f8-247e61c0bec0.png

Am I doing something wrong?

Hi, please use Export task dataset option in the Actions tab.

Regarding orphans container - it's expected, just follow the docker suggestion and add --remove-orphans once.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/openvinotoolkit/cvat/issues/95#issuecomment-900889128, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AK7R4HC5R4OM4CZ22R23MJLT5NO6JANCNFSM4FXJNFWA. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email.

davodogster avatar Aug 18 '21 07:08 davodogster

The workaround described above, exporting the labeled data and using those labels on a subset of images, does not work when using COCO annotations, if the images you wish to ignore already contain labels. I don't think the workaround provided above is sufficient for most CVAT users. This is a rather basic functionality, it is perhaps my team's greatest frustration with CVAT.

Is it possible to exec into the PostgreSQL DB and delete annotated images from there?

ryanalexmartin avatar Nov 02 '21 03:11 ryanalexmartin

any update on this feature?

domef avatar Jul 18 '22 12:07 domef

@domef , it will be available this week.

nmanovic avatar Jul 18 '22 13:07 nmanovic

Hi guys, @carlescarmonacalpe @domef

The feature has been finished and implemented in our CVAT fork, here: https://github.com/cvat-ai/cvat

bsekachev avatar Jul 20 '22 10:07 bsekachev

+1 really need this feature

adamsau avatar Jul 31 '22 09:07 adamsau

@adamsau , is it something which you are looking for? https://cvat-ai.github.io/cvat/docs/manual/advanced/delete_frame/

nmanovic avatar Jul 31 '22 10:07 nmanovic

yes thanks a lot!

adamsau avatar Jul 31 '22 10:07 adamsau

It is possible now, you can update CVAT from develop branch if you want to use the feature.

bsekachev avatar Aug 21 '22 11:08 bsekachev