ActionGenome icon indicating copy to clipboard operation
ActionGenome copied to clipboard

Question about the annotations

Open coldmanck opened this issue 5 years ago • 2 comments

Thanks again for the wonderful work. Regarding the persons & objects annotation, I appreciate if you could clarify my questions below:

  • Is there only a single person (the actor who is supposed to conduct action(s)) annotated for each clip, even if multiple persons appear?
  • Is there only a single object of an object class annotated, even if there are multiple instances of the same object class?
  • Is there any problem regarding the annotation, for example the image below is the first annotated frame from 7H7PN.mp4 (7H7PN.mp4/000048.png), the upper-right command line screenshot is the person box annotation and the lower-right one is the objects & relationships annotations. If the annotated person is the person at the left-hand side who is taking out some stuffs from a bag, how can he simultaneously sitting on the chair (from the bbox coordinate we know that's the one at the right-hand side) and sitting on the floor?

image

coldmanck avatar Jun 24 '20 17:06 coldmanck

Hi @coldmanck

  1. Yes for the current version with person detection only (not really annotation). We're annotating person boxes for multiple persons.
  2. Yes. We've asked the annotators to only localize the object that is being interacted at each moment. E.g. for action "sitting on a chair", only the chair that is being interacted will be localized, rather than all chairs in the scene if there are multiple of them.
  3. This is also a problem when multiple persons are representing in the scene and doing different actions. As we're annotating person boxes, hopefully this issue will be addressed in the next release.

JingweiJ avatar Jun 30 '20 02:06 JingweiJ

Hi @JingweiJ

Thank you for the response. Just wondering, do you have a rough time schedule for the next release? I am asking as I would like to make use of the dataset but the current annotations don’t seem to work for me.

coldmanck avatar Jun 30 '20 03:06 coldmanck