bluelight icon indicating copy to clipboard operation
bluelight copied to clipboard

Display multiple frames in an Image

Open Braisly opened this issue 1 year ago • 21 comments

Hi @cylien and @birdeggb2777 , we are trying to figure out if we are able to see multiple frames of an image with Bluelight but this moment we only can see the first frame. Is that correct?

I saw that there was this development to support multiframe images: https://github.com/cylab-tw/bluelight/issues/10

I understand that right now you can open a multiframe image but you are not able to visualize the other frames.

Thank you.

Braisly avatar Apr 14 '23 13:04 Braisly

Oh, I forgot to assign the branch of the Github Page to the master branch, but I have fixed it now. Could you please try again?

birdeggb2777 avatar Apr 15 '23 04:04 birdeggb2777

Hi @birdeggb2777 , could you add these changes to BLPlugin that we see the branch does not contain the changes?

Moreover in master we are not able to view other frames different from the first. Is this feature in the application to change between frames (this is different to change from instance with mouse wheel)?

image

Could you help us on that to improve Bluelight?

Thank you!

Braisly avatar Apr 17 '23 07:04 Braisly

This PR has been merged into the master, you can switch to the master.

cylien avatar Apr 17 '23 07:04 cylien

This PR has been merged into the master, you can switch to the master.

How do you change between frames @cylien ? We tried in master and it always remains the same frame.

Braisly avatar Apr 17 '23 09:04 Braisly

I tested it and it works fine.

media(1)

cylien avatar Apr 18 '23 00:04 cylien

Hi @cylien,

It looks that some images are working correctly but others not.

For example this image: https://file.io/ydtJ5iJ7vzUc (the file will be deleted when you download it)

If you are not able to download it, let me know. You can view the image on any DICOM Viewer.

Braisly avatar Apr 18 '23 10:04 Braisly

The bug has been fixed. 85cdeb5

cylien avatar Apr 21 '23 00:04 cylien

Hi @cylien and @birdeggb2777,

We saw that the issue related with the previous images is solved but not all multiframe images could be opened correctly with BlueLight.

Look at this example: https://www.dropbox.com/s/k7obz27f07z1kmk/XA-MONO2-8-12x-catheter.gz?dl=0

Let me know how we can proceed to fix this issue.

Thank you so much.

Braisly avatar Apr 24 '23 13:04 Braisly

@Braisly fixed it.

8ffbb14

cylien avatar Apr 27 '23 00:04 cylien

Thank you @cylien but there is another DICOM image that is still failing. We are looking for an example to share with you (as we have not the permission to upload it on the Internet).

Braisly avatar Apr 27 '23 16:04 Braisly

This is the file that Bluelight is not able to process @cylien

162CB78B.zip

Thank you so much!

Braisly avatar May 03 '23 12:05 Braisly

@Braisly fixed it. It had some problems decoding JPEG Baseline (Transfer Syntax UID: 1.2.840.10008.1.2.4.50).

birdeggb2777 avatar May 07 '23 15:05 birdeggb2777

BTW, this IOD is a whole slide image, you can use another project: mainecoon to display it.

We are still writing a new architecture now. The source code on GitHub is still the older version, and it still works fine. I just uploaded the test image to Raccoon and fixed it.

here is the display result: https://cylab-tw.github.io/mainecoon/bluelight-WSI/html/index.html?StudyInstanceUID=1.2.826.0.1.3244452.3.2.1876091050

cylien avatar May 08 '23 01:05 cylien

Thank you @cylien and @birdeggb2777 but with the current changes the BlueLight does not show any major improvement. Now we are able to load the image but we do not view it correctly. At the same time we are not able to change between frames.

Moreover if we upload a heavier images than the previous, we are not able to load them.

The Mainecoon looks a great viewer but we need to tag images from different sources and we believe that BlueLight is a suitable tool for this task.

How can we help you to process Pathology images on Bluelight? To see the different frames and load these kind of images properly.

Let us know if you need any help, we appreciate your big effort @cylien and @birdeggb2777 .

Braisly avatar May 08 '23 11:05 Braisly

with the current changes the BlueLight does not show any major improvement. Now we are able to load the image but we do not view it correctly.

We are trying to fix it in BlueLight ASAP. However, this type of image is not proper for displaying in BlueLight.

How can we help you to process Pathology images on Bluelight? To see the different frames and load these kind of images properly.

Some features e.g. tag, XNAT, in BlueLight may be added in Mainecoon that I will discuss with developers in a future version. Perhaps you can use BlueLight to tag the image and view WSI in Mainecoon.

cylien avatar May 09 '23 01:05 cylien

@Braisly this bug had been fixed. b93a407

cylien avatar May 15 '23 03:05 cylien

@cylien It looks that now is working properly for images with small size.

Nevertheless for an image of 155.000 KB Bluelight is not able to load it correctly (major size 155 MB). But this is another problem.

Braisly avatar May 16 '23 13:05 Braisly

Nevertheless for an image of 155.000 KB Bluelight is not able to load it correctly (major size 155 MB). But this is another problem.

DICOM WG-26 recommends viewer can query and retrieve the WSI from a DICOMweb server for displaying partial frames to avoid downloading whole images which are huge in size. (in your case). The design of BlueLight is for general medical images mostly radiography so we also developed another DICOM viewer, especially for dealing with WSI.

Even though BlueLight cannot display huge sizes of WSI, I have tested that BlueLight has a limitation is about up to 100MB for displaying all frames in WSI, the tag function is still operable.

cylien avatar May 17 '23 00:05 cylien

Hmmmm but with a minor step with BlueLight you will be able to open any image. Probably with one viewer is more useful for the user.

What are the restrictions for the BlueLight as a universal viewer? What are your thoughts?

Braisly avatar May 19 '23 07:05 Braisly

BlueLight supports the display for most of the DICOM SOP class of the DICOM objects, such as radiographic images, annotations, video, and SR which is similar to the other commercial or open-source/open software DICOM viewers.

Recently, the tools for the DCOM WSI have been increasing rapidly in recent years. However, the WSI is not an entirely new SOP class in DIOCM, this standard has been released over 10 years. I think that is because of the new communication protocol in DICOM i.e., DICOMweb facilitates the development of the digital pathology e.g., some WSI tools such as OpenSlide, Orthanc Plugin for WSI, Slim, Google WSI Viewer, etc., were created.

We had tried to integrate the display of WSI in native BlueLight, however, it didn't reach the target effect that we expected. Because the behavior in operating digital pathology is totally different than general medical image.

For example, WSI required a mini-map to display the global location when the user navigating the pathology image which is not necessary for general medical images. The other example is for navigating images, WSI is required to cascade all frames to construct a map, and zoom to switch ratios of slide images. That operational behavior conflicts with the general medical image.

In addition, the software architecture of BlueLight will be refactored if BlueLight is compatible with these two types of images that BlueLight will become "fatter" and "over-engineering". So we designed an independent WSI Viewer differing from BlueLight which is similar to the other projects such as Orthanc, and Slim.

The following demonstration shows the prototype of the BlueLight plugin for WSI connected to a DICOMweb server one year ago. ezgif-4-79cde9ff46

cylien avatar May 21 '23 05:05 cylien

Hi! Working on a Tomosynthesis image, the WW/WL values applied to an image are not preserved when scrolling to the adjacent images, requiring continuos WW/WL adjustments.

Terabuck avatar Nov 21 '23 04:11 Terabuck