rasterframes
rasterframes copied to clipboard
Geospatial Raster support for Spark DataFrames
Something in caching mechanism is going wrong and resulting in the file TiffTags being read for every tile. Attached is a CPU sample of a RasterFrames job that highlights the...
Pushing for Spark 3.2, very draft
When I read the tif file using pure sql, the shema of the dataframe prints wrong and cannot read the data. ```scala val readSql = s""" |CREATE OR REPLACE TEMPORARY...
Bumps [pyspark](https://github.com/apache/spark) from 3.1.2 to 3.1.3. Commits d1f8a50 Preparing Spark release v3.1.3-rc4 7540421 Preparing development version 3.1.4-SNAPSHOT b8c0799 Preparing Spark release v3.1.3-rc3 0a7eda3 [SPARK-38075][SQL][3.1] Fix hasNext in HiveScriptTransformationExec's pro... 91db9a3...
This is a draft and example of how the shapefile datasource can be implemented. Its functionality is pretty limited: * it can only extract geometry out of a `SimpleFeature` *...
in Getting Started python3 -m pip install pyrasterframes import pyrasterframes from pyrasterframes.utils import create_rf_spark_session spark = create_rf_spark_session() Error setting up SparkSession; cannot find the pyrasterframes assembly jar 'JavaPackage' object is...
Environment variables such as `AWS_REQUEST_PAYER` and `AWS_DEFAULT_REGION` aren't incorporated into `s3://` reads.
Hi, @metasim , @vpipkt , I'd like to report a vulnerable dependency in **org.locationtech.rasterframes:rasterframes_2.12:0.10.1**. ### Issue Description I noticed that **org.locationtech.rasterframes:rasterframes_2.12:0.10.1** directly depends on **org.apache.spark:spark-core_2.12:3.1.2** in the [pom](https://repo1.maven.org/maven2/org/locationtech/rasterframes/rasterframes_2.12/0.10.1/rasterframes_2.12-0.10.1.pom). However, as...