skrub-data
[WIP] Interpolationjoiner dataframe api
this changes the InterpolationJoiner to rely on the dataframe api (and some utilities added to skrub._dataframe) so that it works with polars
the tests are now parametrized with a fixture px that becomes pandas and polars
In the utilities we added to skrub._dataframe, I believe make_dataframe, make_series, join, could use the dataframe api instead
and it seems our oldest supported pandas version does not support the dataframe api?
I bumped the pandas version just to see if the CI runs but having the dataframe api requires pandas 2.1.0 release notes which dates from august 2023
@MarcoGorelli in case you have the time I'm sure you would have advice for better use of the dataframe API in this one!
ooh, seeing you try this out has made my day! got some things I need to finish now but I'll take a careful look and see what we need to change upstream (I'm sure something will come up 😄 )
ooh, seeing you try this out has made my day!
I'm sooo happy about this PR, Marco! I love the way the support for polars is building in skrub
If the dataframe-api-compat is not mature enough yet, it might be wiser to wait rather than to have to change a lot of logic three months later
FWIW I'm aiming to tag the first non-beta version by February https://github.com/data-apis/dataframe-api/issues/319. Til then, I'm extremely happy if people experiment with it, but I would caution against putting a lot of work into using it
after all we won't be using the dataframe API for this so it will be easier to just start a new branch