Potential Issue With GeoTiff Reading in the Future due to too large segments dimensions

[jbouffard]

Currently, the way we store segment data of GeoTiffs is via an Array[Byte]; as can be seen here. This method could cause future problems, though. By storing the Bytes in an Array[Byte], the max size of a segment is 2 GB. While this is not an issue now, the ever increasing size of GeoTiffs could one day cause the our GeoTiffReader to fail.

Resolving this issue would require us to refactor/rewrite large portions of geotrellis.raster.io.geotiff, so I'm not sure if/when work should begin on resolving this . It should be noted, however, that the BigTiff version of the libtiff library still treats segments as an Array[Byte], link. Thus, this probably isn't an immediate concern, but it is something to keep in mind for the future.

[pomadchin]

It's actually not a potential issue, but it's an existing bug. We already had a case provided by @tosen1990; he had a tiff with segments that could not fit Array max length.

[tosen1990]

@pomadchin I'm sorry for that I still yet upload big tiff for you.I'll do it as soon as possible to send the tiff to my friend in us.And let him upload it to aws or somewhere.

[pomadchin]

Example file that can't be processed: s3://geotrellis-test/issue-1691/firstPart.tif