rasterframes

rasterframes copied to clipboard

The error occurs when running the following code： from pyspark.sql import SparkSession import pyrasterframes from pyrasterframes.rasterfunctions import * from pyspark.sql.functions import lit from pyspark.sql.functions import col import os from pyrasterframes.utils...

1997tzd

While using RasterFrame, I noticed an issue with the registration of the UDF rf_data_cells. It should use org.locationtech.rasterframes.expressions.tilestats.DataCells, but it is incorrectly registered as org.locationtech.rasterframes.expressions.aggregates.CellCountAggregate.DataCells. Why is this happening? [DataCells](https://github.com/locationtech/rasterframes/blob/develop/core/src/main/scala/org/locationtech/rasterframes/expressions/package.scala#L139)...

RunBoo

Spark 3.5: Fix StaticInvoke constructor differences in ManualTypedEncoder; add tests; fixes #630

2

Problem: Spark 3.5 changed org.apache.spark.sql.catalyst.expressions.objects.StaticInvoke constructor shape, breaking reflective construction used by encoders. Solution: Build StaticInvoke reflectively by selecting the max-arity constructor (8/9 args) and trying both target class and...

AnudeepKonaboina

**Context** On some Spark 3.5 builds, StaticInvoke has a 9-arg signature; RF binaries expect 8-arg, throwing NoSuchMethodError: ``` NoSuchMethodError: org.apache.spark.sql.catalyst.expressions.objects.StaticInvoke.( Ljava/lang/Class; Lorg/apache/spark/sql/types/DataType; Ljava/lang/String; Lscala/collection/Seq; Lscala/collection/Seq; Z Z Z )V ```...

anudeepkonaboina-db