rasterframes icon indicating copy to clipboard operation
rasterframes copied to clipboard

`spatialJoin` handle newer default columns

Open vpipkt opened this issue 7 years ago • 0 comments

currently the rf.spatialJoin(rf2) operation will clean up duplicates in the spatial and temporal keys, but not in related columns: bounds, timestamp

Although not explictly joining on those columns we can safely drop duplicated columns on either side of the join to avoid name collisions on the returned dataframe. Note spark does not mind the name duplication in the schema but it becomes impractical to query on those columns.

vpipkt avatar May 13 '18 14:05 vpipkt