Jay Chia
Jay Chia
Ok yeah this might be a Hudi issue in general then. Do you mind filing an issue against `hudi-rs` and linking that issue here please @sephib ?
Very cool. I was just chatting with @paleolimbot about whether Daft could remove its dependency on PyArrow at some point and rely on something lighter-weight to do import/export of arrow...
Thanks for providing the Colab! I think we can go off of that to easily see what functionality we still lack and need to prioritize cc @universalmind303
Closing as inactive
As of #2677, there are a few remaining todos: - [ ] Add tests and fixes for accounting for `init_args` and `batch_size` when running the stateful UDFs - [ ]...
Closing this as it is done, but needs to make it through last bits of dogfooding/testing from @kevinzwang to push past the finish line.
> I feel like this might be a breaking change yeah... I think better to break now... I know that @gmweaver relies on `from daft.udfs import ...` but other than...
I'd love to have one that would give us really nice views in HTML so we can leverage it in notebooks!!
I didn't know there was a standard for this -- sounds good to me! The main things that would need to fix would be: * https://github.com/Eventual-Inc/Daft/blob/main/.github/release-drafter.yml * https://github.com/Eventual-Inc/Daft/blob/main/.github/workflows/pr-labeller.yml#L40-L67 Should be...
I will defer to @kevinzwang on this as I know there is a new UDF design proposal underway @kevinzwang shall we post a Github discussion or similar once we arrive...