rasterframes
rasterframes copied to clipboard
Geospatial Raster support for Spark DataFrames
Suspicion is this is caused by a NoData tile, or a tile where all the values are zero. ``` org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage...
see skipped unit test here: https://github.com/locationtech/rasterframes/blob/419a920f54f27b8e14ea743b1d864443f0bdb394/pyrasterframes/src/main/python/tests/RasterFunctionsTests.py#L293-L317 Unsure why this is happening. See also this similar and passing unit test. https://github.com/locationtech/rasterframes/blob/419a920f54f27b8e14ea743b1d864443f0bdb394/pyrasterframes/src/main/python/tests/PyRasterFramesTests.py#L144-L158
During docs build I see a lot of this, even after cleaning up `~/.rf_cache` dir. ``` WARN CSVDataSource: CSV header does not conform to the schema. Header: productId, entityId, acquisitionDate,...
Reconstructing and writing small overview geotiffs is unexpectedly slow.
What I'd like to do: ``` chipped_rf.filter(rf_dimensions('B4') == (256, 256)) ``` What I had to do instead: ``` chipped_rf.filter(rf_dimensions('B4).cols == 256).filter(rf_dimensions('B4').rows == 256) ```
It would save end users headaches if we could check for gdal when `create_rf_spark_context` is called, confirm the version is compatible, and pass the library path to the JVM.
Two points of friction: 1) almost always and everywhere we are doing "rasterize geometry like this projected raster tile" and then having to pass in the various metadata bits of...
I would like to check if pyrasterframes is compatible with some version of Hadoop. My primary concern if for the s3 integration through minio. My first attempt is to set...
### Current situation I have a geotrellis catalog using the S3 backend. Catalog and data are stored on a minio server. I'm using Geotrellis v2.3.3 When I try to access...
This may point to an issue in one of the functions like `rf_render_png` ``` Py4JJavaError: An error occurred while calling o90._dfToHTML. : org.apache.spark.SparkException: Job aborted due to stage failure: Task...