Processing on AWS

[rodolfolotte]

Just did a small example for stacking Sentinel-1 images, but something is still wrong!

The method is mostly what is presented in this repository's example:

def stack_images(images_path, aoi):
    """
    :param images_path:
    :return:
    """
    absolute_path = os.path.abspath(images_path)
    output_mosaic_path = absolute_path.replace('filter', 'stack')
    aois_path = settings.DATASET_PATH + 'radar/aoi/shp/'
    output_shp_file = aois_path + aoi + ".shp"

    srcfiles = finder(images_path, ['^S1[AB]'], regex=True, recursive=False)
    groups = groupbyTime(srcfiles, seconds, 30)

    try:
        os.makedirs(output_mosaic_path)
    except FileExistsError:
        pass

    stack(srcfiles=groups, dstfile=output_mosaic_path + "/" + 'stack.tiff', resampling='bilinear',
          targetres=[20, 20], srcnodata=0, dstnodata=-99,
          shapefile=output_shp_file, sortfun=seconds, separate=False, overwrite=True)

Just to make clear, the srcfiles variable brings all original sentinel images:

['.../iw-vh/S1A_IW_GRDH_1SDV_20180525T093134_20180525T093159_022059_026254_0ED2_iw-vh.tiff', '/.../iw-vh/S1A_IW_GRDH_1SDV_20180525T093159_20180525T093224_022059_026254_DE25_iw-vh.tiff', '.../iw-vh/S1A_IW_GRDH_1SDV_20180525T093224_20180525T093249_022059_026254_28B8_iw-vh.tiff', '.../iw-vh/S1A_IW_GRDH_1SDV_20180530T093955_20180530T094020_022132_0264A6_04BA_iw-vh.tiff', '.../iw-vh/S1A_IW_GRDH_1SDV_20180530T094020_20180530T094045_022132_0264A6_A27A_iw-vh.tiff', '.../iw-vh/S1A_IW_GRDH_1SDV_20180530T094045_20180530T094110_022132_0264A6_D444_iw-vh.tiff']

but still getting this error:

Traceback (most recent call last):
  File "/home/rodolfo/Bit/lotte/aws-imagery/.venv/lib/python3.7/site-packages/spatialist/auxil.py", line 63, in crsConvert
    srs.SetFromUserInput(crsIn)
  File "/home/rodolfo/Bit/lotte/aws-imagery/.venv/lib/python3.7/site-packages/osgeo/osr.py", line 1068, in SetFromUserInput
    return _osr.SpatialReference_SetFromUserInput(self, *args)
RuntimeError: OGR Error: Corrupt data

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "aws_cli.py", line 114, in <module>
    main(args.ranges)
  File "aws_cli.py", line 70, in main
    dip.stack_images(path_to_pol, aoi)
  File "/home/rodolfo/Bit/lotte/aws-imagery/aws_process.py", line 82, in stack_images
    shapefile=output_shp_file, sortfun=seconds, separate=False, overwrite=True)
  File "/home/rodolfo/Bit/lotte/aws-imagery/.venv/lib/python3.7/site-packages/spatialist/raster.py", line 1231, in stack
    group = [x for x in group if intersect(shp, Raster(x).bbox())]
  File "/home/rodolfo/Bit/lotte/aws-imagery/.venv/lib/python3.7/site-packages/spatialist/raster.py", line 1231, in <listcomp>
    group = [x for x in group if intersect(shp, Raster(x).bbox())]
  File "/home/rodolfo/Bit/lotte/aws-imagery/.venv/lib/python3.7/site-packages/spatialist/raster.py", line 426, in bbox
    return bbox(coordinates=extent, crs=crs)
  File "/home/rodolfo/Bit/lotte/aws-imagery/.venv/lib/python3.7/site-packages/spatialist/vector.py", line 725, in bbox
    srs = crsConvert(crs, 'osr')
  File "/home/rodolfo/Bit/lotte/aws-imagery/.venv/lib/python3.7/site-packages/spatialist/auxil.py", line 66, in crsConvert
    '  was: "{}" of type {}'.format(crsIn, type(crsIn).__name__))
TypeError: crsIn not recognized; must be of type WKT, PROJ4 or EPSG
  was: "" of type str

Seems to be some projection missing data! But I'm using original image and check with another softwares, which gave me the correct metadata!