polars
polars copied to clipboard
feat(rust): integrate delta-rs
Integrate the delta-rs library for interacting with the Delta reader.
https://github.com/pola-rs/polars/issues/2858
I would also like this functionality on the Python side; though that would also be possible by using the Delta package and going through pyarrow.
@stinodego in python you could use something like this
from deltalake import DeltaTable
import pyarrow.parquet as pq
def delta_to_pl(path: str):
ds = pq.ParquetDataset(
DeltaTable(path).file_uris()
).read()
return pl.DataFrame(ds)
Some parts of the PR merged, the rest not of interest.