magellan
magellan copied to clipboard
Geo Spatial Data Analytics on Spark
Hello: Can you please let me know how soon there will be Python Support?? Thanks
The change includes adding support for Apache Spark 2.4.3 and Open JDK 8 It also removed backward compatibility for the Spark Version below 2.3.0. There is no feature change hence...
The Python API was broken after 1.0.4 release (incompatibility with Spark SQL after Spark 1.5) and we haven't fixed it yet.
Add Support for Spark 2.4.3 and above #242
I am getting below error when checking if point falls within polygon. Here is the error. org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 3.0 failed 1...
Hi, this is my first ever PR to anything, so please bear with me if I have done something terribly illegal/bad practice :) I have updated a range of the...
Currently trying to join to dataframes with the following command: `val df_green_pickup = green_data.join(neighborhoods).where($"pickup_point" within $"polygon") display(df_green_pickup)` Having the following exception: `SparkException: Job aborted due to stage failure: Task 0...
``` val spark = SparkSession.builder .appName("Testing Spark DSL") .master("local[1]") //build a local cluster .getOrCreate() // injectRules(spark) import spark.implicits._ val data = Array(("US", "TX", "2018-12-08 00:00:00", 12.0123, "ios", 2, 32.813548, -96.835159),...
I need to use a functionality which is part of the current master but is not a part of the latest release (More specifically, read shapefiles (Polygons and Points) and...