Ram Sriharsha

Does this preserve backward compatibility with Spark 2.3?

@laurikoobas how big a cluster are you using? and what is the node configuration? if you can share the polygon dataset it would be easier to debug this.. otherwise one...

I'm not familiar with Glue, but I think the amount of memory you need for these polygons might be tipping you over the 5GB limit you have set for the...

You want to pick a precision that can eliminate a large fraction of polygons..eg if your polygons are US states and you pick say precision of 10/15 each polygon roughly...

precision is nothing but the geohash precision https://gis.stackexchange.com/questions/115280/what-is-the-precision-of-a-geohash instead of characters, we are using the bit size (so to convert to geohash character length simply divide by 5). eg, precision...

hey! A ZOrderCurve has a function called .toBase32() that returns the geo hash string (which is nothing but a base 32 encoded string). So all you'd need to do is...

@mengqingyun what functions did you have in mind? what are the high priority ones for you, and can you give me use cases ? we plan to fully support as...

there is no official build for Spark 1.6 you can download the source code with this tag: https://github.com/harsha2010/magellan/tree/SPARK-1.6 and compile it yourself. sbt/sbt clean test spDist You should try Magellan...

WKT parser does not support multipolygons yet Neither does Shapefile format. Only GeoJSON does right now It's not prioritized, happy to accept contributions :)

Multipolygons are in general not fully supported in parsing. But once parsed they will be treated as one polygon per row essential flatmapping them. The rest of the processing then...