rasterframes icon indicating copy to clipboard operation
rasterframes copied to clipboard

Geospatial Raster support for Spark DataFrames

Results 120 rasterframes issues
Sort by recently updated
recently updated
newest added

Something in caching mechanism is going wrong and resulting in the file TiffTags being read for every tile. Attached is a CPU sample of a RasterFrames job that highlights the...

bug

Pushing for Spark 3.2, very draft

When I read the tif file using pure sql, the shema of the dataframe prints wrong and cannot read the data. ```scala val readSql = s""" |CREATE OR REPLACE TEMPORARY...

Bumps [pyspark](https://github.com/apache/spark) from 3.1.2 to 3.1.3. Commits d1f8a50 Preparing Spark release v3.1.3-rc4 7540421 Preparing development version 3.1.4-SNAPSHOT b8c0799 Preparing Spark release v3.1.3-rc3 0a7eda3 [SPARK-38075][SQL][3.1] Fix hasNext in HiveScriptTransformationExec's pro... 91db9a3...

dependencies

This is a draft and example of how the shapefile datasource can be implemented. Its functionality is pretty limited: * it can only extract geometry out of a `SimpleFeature` *...

in Getting Started python3 -m pip install pyrasterframes import pyrasterframes from pyrasterframes.utils import create_rf_spark_session spark = create_rf_spark_session() Error setting up SparkSession; cannot find the pyrasterframes assembly jar 'JavaPackage' object is...

question

Environment variables such as `AWS_REQUEST_PAYER` and `AWS_DEFAULT_REGION` aren't incorporated into `s3://` reads.

Hi, @metasim , @vpipkt , I'd like to report a vulnerable dependency in **org.locationtech.rasterframes:rasterframes_2.12:0.10.1**. ### Issue Description I noticed that **org.locationtech.rasterframes:rasterframes_2.12:0.10.1** directly depends on **org.apache.spark:spark-core_2.12:3.1.2** in the [pom](https://repo1.maven.org/maven2/org/locationtech/rasterframes/rasterframes_2.12/0.10.1/rasterframes_2.12-0.10.1.pom). However, as...

enhancement