AsOfJoin with subset of partitioning columns on right side

[MartinRoth]

Hi,

I have a timeseries with sensor readings for many different motors of several machines and a timeseries with the products that run on the respective machine. The sensor readings are partitioned by machine and motor and the products are partitioned by machine only.

Currently I have to transform the tsdf object of the sensor readings back to a normal data frame object and make a new tsdf object that is only partitioned by the machine to make the asof join. I assume this is a common use case and allowing less partitions on the right side of the asof join would be very convenient.

Cheers, Martin

[rportilla-databricks]

Hi Martin, we will take a look at this in a meeting next week to prioritize. Thanks for sending!

[tnixon]

Revisiting this feature request, it seems reasonable - we will implement ASAP