rasterframes
rasterframes copied to clipboard
Geospatial Raster support for Spark DataFrames
Refer to this build: https://3415-174014757-gh.circle-artifacts.com/0/rf-site/index.html * In `unsupervised-learning.pymd` the final prediction raster is a single color:  * In `masking.pymd` the masks from `SCL` aren't rendered properly as tiles. However,...
Dear All, I have written a scala function to read "geotrellis catalog" data using rasterframe firstly, then do unsupervised machine learning with geotrellis. After that, the result of classification need...
In org.locationtech.rasterframes.ref.HadoopGeoTiffRasterSource, line 34: The file path of HDFS obtained through ‘source.getPath’ lost important protocol, IP and other information, , resulting in the path error when getting the file
https://github.com/locationtech/rasterframes/pull/301/files#diff-0fe6afd825a768bd52f15c3f103e8b00R46 PR #301 recommended this issue... Enable the user to select color ramp for tile rendering in the HTML / MD outputs.
Test: ```scala val catalog = spark.read.l8Catalog.load() val df = spark.read.raster .fromCatalog(catalog, "B1", "B8") .load() ``` Error: ```java 19/07/01 09:28:00 ERROR RasterSourceToRasterRefs: Error fetching data for one of: GDALRasterSource(https://s3-us-west-2.amazonaws.com/landsat-pds/c1/L8/003/048/LC08_L1TP_003048_20180805_20180814_01_T1/LC08_L1TP_003048_20180805_20180814_01_T1_B1.TIF), GDALRasterSource(https://s3-us-west-2.amazonaws.com/landsat-pds/c1/L8/003/048/LC08_L1TP_003048_20180805_20180814_01_T1/LC08_L1TP_003048_20180805_20180814_01_T1_B8.TIF) java.lang.IllegalArgumentException:...
Data scientist feedback suggests adding something like `rf.agg(rf_agg_unique(rf.tile))` It should compute a single Row with an ArrayType col having all distinct values in all cells in the column. Alternative might...
As of now, the docs explain how to convert a `RasterFrame` to either an `RDD` or a `TileLayerRDD` only. It'd be nice to also have a section on how to...
_From @metasim on September 25, 2017 19:41_ Tests in `RasterFrameSpec` and `ExplodeSpec` show this. _Copied from original issue: s22s/raster-frames#27_
currently the `rf.spatialJoin(rf2)` operation will clean up duplicates in the spatial and temporal keys, but not in related columns: bounds, timestamp Although not explictly joining on those columns we can...
# Description With various logical local algebra operations, a `bool` cell type tile is returned. ```python from pyrasterframes.rasterfunctions import rf_local_equal, rf_convert_cell_type from pyspark.sql.functions import lit df = spark.read.raster('/data/raster/example.tif') df =...