rasterframes icon indicating copy to clipboard operation
rasterframes copied to clipboard

`spatial_index_partitions` on large (~2000) catalogs causes Kryo serialization issues.

Open metasim opened this issue 5 years ago • 0 comments

Only 70% sure this is a bug, but need to be wary of it.

Same issue as this:

https://stackoverflow.com/questions/37709770/resolving-kryo-serialization-failed-buffer-overflow-spark-exception

Appears that adding the spatial index may get evaluated in a non-distributed way.

metasim avatar Sep 01 '20 16:09 metasim