rasterframes
rasterframes copied to clipboard
Geospatial Raster support for Spark DataFrames
Hi Everyone, Has anyone ever tried to mask Sentinel 2 10mt bands using SCL band 20mt. If so can someone help out with the workflow. Following is what I tried:...
I have rasterframes version 0.11.1. When I try to use the rf_resample function: **df.select(rf_resample("proj_raster.tile", 0.25, "max"))**, I get the following error: **rf_resample() takes 2 positional arguments but 3 were given**...
I have a installation of GDAL. "from osgeo import gdal" works perfectly but when I try to run from pyrasterframes.utils import gdal_version print(gdal_version()) I get "not available" as output. I...
Circle CI is not longer cool. It would be great to manage releases from GitHub Actions, let us start by handling SNAPSHOTs first.
I used pyrasterframes v0.10.1 with Databricks 9.1 LTS ML (includes Apache Spark 3.1.2, Scala 2.12). I get the following error and cannot access the dataframe. ``` --------------------------------------------------------------------------- Py4JJavaError Traceback (most...
currently trying to perform operations Databricks but the last usable version of the assembly .jar file was for Databricks 5.5 and this is no longer supported by Databricks. Current LTS...
spark-submit failed with following error: ``` py4j.protocol.Py4JJavaError: An error occurred while calling None.org.locationtech.rasterframes.py.PyRFContext. : java.lang.NoSuchMethodError: 'shapeless.DefaultSymbolicLabelling shapeless.DefaultSymbolicLabelling$.instance(shapeless.HList)' at org.locationtech.rasterframes.encoders.StandardEncoders.spatialKeyEncoder(StandardEncoders.scala:68) at org.locationtech.rasterframes.encoders.StandardEncoders.spatialKeyEncoder$(StandardEncoders.scala:68) at org.locationtech.rasterframes.package$.spatialKeyEncoder$lzycompute(package.scala:39) at org.locationtech.rasterframes.package$.spatialKeyEncoder(package.scala:39) at org.locationtech.rasterframes.StandardColumns.$init$(StandardColumns.scala:42) at org.locationtech.rasterframes.package$.(package.scala:39) at...
Bumps [pillow](https://github.com/python-pillow/Pillow) from 10.0.1 to 10.3.0. Release notes Sourced from pillow's releases. 10.3.0 https://pillow.readthedocs.io/en/stable/releasenotes/10.3.0.html Changes CVE-2024-28219: Use strncpy to avoid buffer overflow #7928 [@hugovk] Use functools.lru_cache for hopper() #7912 [@hugovk]...
Bumps [black](https://github.com/psf/black) from 22.12.0 to 24.3.0. Release notes Sourced from black's releases. 24.3.0 Highlights This release is a milestone: it fixes Black's first CVE security vulnerability. If you run Black...
 import org.apache.spark.sql.{SparkSession, DataFrame} import org.apache.spark.ml.classification.{DecisionTreeClassifier, DecisionTreeClassificationModel} import org.apache.spark.ml.feature.VectorAssembler import org.apache.spark.ml.linalg.Vector import org.apache.spark.sql.functions._ object ActiveLearningExample { def main(args: Array[String]): Unit = { val spark = SparkSession.builder() .appName("ActiveLearningExample") .master("local[*]") .config("spark.driver.host", "localhost")...