magellanmapper icon indicating copy to clipboard operation
magellanmapper copied to clipboard

Killed when appied in bigger data

Open Whiteglad opened this issue 3 years ago • 5 comments

When I run the smooth script for bigger data(upsampled 2X ), it was killed. What is the maximum resolution that this tool can handle?

Whiteglad avatar Apr 16 '21 02:04 Whiteglad

Thanks for asking, @Whiteglad, and great question. In practice the image size is mainly limited by the system memory, so it may be platform-dependent. There are size limits based on file format, but the tool's readers (NumPy for NPY files, or ITK for other formats such as MHD/MHD, NIfTI, etc) should be able to read existing images regardless of size (as far as I know). What is the size of the image you are loading?

It could be that there was an out of memory error when loading the large image. Could you let me know what command you ran and the error message you encountered? Are you using Mac or Windows (or Linux)? Also, did it work for you on the original data, but was killed with the larger data?

yoda-vid avatar Apr 16 '21 03:04 yoda-vid

I could easily load a 4.3 GB file into the GUI without the importer. I tried a 88.3 GB lightsheet tif-file using the importer, it needed about 30min to load but after that it worked pretty fine. Scrolling through slices, zooming works smooth.

SaibotMagd avatar Apr 19 '21 10:04 SaibotMagd

Thanks, @SaibotMagd, glad it's working!

Just to note that images formats loaded without requiring import (eg MHD/MHA files loaded through SimpleITK) are fully loaded into memory, so they can become memory constrained. There's a way to access these images by ROI but haven't had a chance to implement it yet.

yoda-vid avatar Apr 20 '21 07:04 yoda-vid

There's a way to access these images by ROI but haven't had a chance to implement it yet.

  1. Load the picture into e.g. ImageJ as VirtualImage (bio-image plugin), it only loads a single slice at the same time
  2. use the command: " python run.py --img sample_region/myvolume --proc load --offset 30,35,30 --size 25,25,12 to set the to-be-loaded ROI in mag.

SaibotMagd avatar Apr 26 '21 09:04 SaibotMagd

This is super helpful, thanks for pointing it out, @SaibotMagd!

yoda-vid avatar Apr 26 '21 11:04 yoda-vid