Display and annotate image/video from the same "group" in grid-like "hanging protocol"

[rphila]

My actions before raising this issue

• [x ] Read/searched the docs
• [x ] Searched past issues

Expected Behaviour

I am using CVAT for medical imaging and one feature that is crucial is being able to display images/video in a "hanging protocol".

The user should be able to view all images and videos from the same patient in a grid layout on the viewer. Then they should be able to click on any of these images/videos to zoom in and annotate.

Current Behaviour

Currently there is no ability to display multiple images and videos that are grouped together on the same screen and be able to zoom/navigate/annotate them separately.

Currently it would involve many steps, or opening multiple browsers to compare images/videos from different Tasks that are suppose to belong to the same "grouping". This is a common workflow in medical imaging where the user will need to see multiple images and videos from the same body part of a patient taken at different angle views before making their annotations.

Possible Solution

Hanging protocol may be similar to having multiple "context images" as a grid on the canvas. So a "Project" could be used to group all "Tasks" that belong to a patient. When one opens the "Project", it will display a grid of all the images/videos from Tasks in that Project. Users should be able to click on any of the images/video in this grid without being taken to another page. When clicking on the image/video, it will expand to fit the canvas (similar to what happens when you click on a "context image" and it expands to fit the canvas). However, the user should be able to zoom, play if video, and annotate as you would in a normal Task.

Context

This is a common workflow for annotation of medical imaging. I have looked into other medical imaging specific annotation tools (such as https://ohif.org/) which do have the "hanging protocol" feature where images/videos from same patient are able to be displayed in a grid and then played/annotated independently. However, there is a learning curve with having to start using a new annotation tool when I am already familiar with CVAT.

Your Environment

Using AWS EC2 ubuntu server

Next steps

You may join our Gitter channel for community support.

[lvbirui]

that's a very important feature, in my company's useing, we also needt this feature, and we are tring to relize this feature.

[rphila]

Here is an example of another annotation product showing 4 different images/videos in hanging protocol:

https://docs.v7labs.com/docs/beta-create-hanging-protocols-with-dicom-layouts