knip icon indicating copy to clipboard operation
knip copied to clipboard

Image Reader fails with large image planes

Open imagejan opened this issue 9 years ago • 10 comments

When trying to read images with more than ~20000x20000 pixels (czi files > 4GB), Image Reader fails with:

Encountered exception while reading image 1-2-Scene-2-ScanRegion1.czi! Caught Exception: Array size too large: 3 x 26082 x 26082 x 2

Switching to Cell Image Factory in the advanced options leads to:

Encountered exception while reading image 1-2-Scene-2-ScanRegion1.czi! Caught Exception: No compatible service: io.scif.SCIFIOService

As a workaround, it would already help to have a crop option for import, see #317.

imagejan avatar Jun 23 '16 09:06 imagejan

Thanks @imagejan! I will take a look.

dietzc avatar Jun 23 '16 11:06 dietzc

A sample .czi file of this size would be very useful, as it is hard to get access to such images.

beschu avatar Dec 12 '16 14:12 beschu

@imagejan can you send us a .czi file for testing?

tibuch avatar Jan 11 '17 13:01 tibuch

@tibuch @beschu I can't share the file publicly, but I can upload it somewhere for you to access. Do you have a KNIME ftp server for these cases? The file is about 4.5 GB.

imagejan avatar Jan 12 '17 08:01 imagejan

I uploaded an example file (1-2-Scene-2-ScanRegion1.czi) to the ftp server as communicated by @gab1one. Thanks for looking into this.

imagejan avatar Jan 12 '17 12:01 imagejan

ah, sorry for the duplicate :) just as a wrap-up: this bug also affects TIFF files read by the latest stable version of KNIP shipped with KNIME 3.3.1.

maierl avatar Feb 14 '17 11:02 maierl

Our users (neurobiologists working with large stitched z-stacks) repeatedly keep running into this issue, so here's a small update:

The Image Reader also fails on ics/ids files that are >4GB in size in total, even if the single planes are much smaller than 4 Gigapixel. It think it is related, or should I open a new issue for this one?

imagejan avatar Feb 21 '17 14:02 imagejan

@imagejan can you share the file with me somehow?

dietzc avatar Feb 21 '17 22:02 dietzc

I'll upload a sample ics/ids dataset later today to the same ftp server as discussed above, alright?

imagejan avatar Feb 22 '17 07:02 imagejan

I uploaded the 4.6 GB dataset consisting of mosaic_1.ics and mosaic_1.ids into the incoming root folder of the ftp server.

imagejan avatar Feb 22 '17 15:02 imagejan