rasterframes
rasterframes copied to clipboard
locationtech
Geospatial Raster support for Spark DataFrames
Ensure our modifications to the incoming URI string work downstream in `VSIPath` for Windows local files.
And enforce other logic like can't read a gdal only format (mrf, jp2) outside the gdal reader. Needs a close look and maybe more extensive unit tests. Possibly also more...
The docs build is now broken due to ModuleNotFound errors because dependencies are not installed by default in the current build. The build will install some dependencies via conda (formerly...
I am using pyrasterframes in cluster mode, by invoking pyspark shell as specified [here](https://rasterframes.io/getting-started.html#using-pyspark-shell): ``` pyspark --conf spark.pyspark.virtualenv.enabled=true --conf spark.pyspark.virtualenv.type=native --conf spark.pyspark.virtualenv.requirements=/opt/requirements.txt --conf spark.pyspark.virtualenv.bin.path=/opt/python36/bin --master yarn --num-executors 1 --driver-memory 8g...
https://github.com/locationtech/rasterframes/blob/8bbed00ab7970a4003533cadc99173e2a5ab7838/datasource/src/test/scala/examples/ValueAtPoint.scala#L46 Would like to have this as a column function. Originally brought up by @lalessan on [gitter](https://gitter.im/locationtech/rasterframes?at=5fce39b2c980287e367edda4)
The matcher [here](https://github.com/locationtech/rasterframes/blob/0.9.0/core/src/main/scala/org/locationtech/rasterframes/ref/RFRasterSource.scala#L112-L123 ) displays a warning about specific URI unable to be read, but debugging would benefit from a more detailed logging of the various conditions involved. Meaning: what...
> ... It might be useful to have the option for setting the number of buckets though. _Originally posted by @courtney-whalen in https://github.com/locationtech/rasterframes/issues/519#issuecomment-719805265_
Metadata
Owner
Metadata
Geospatial Raster support for Spark DataFrames