Jay Chia comments

Results 126 comments of


                                            Jay Chia

Add a `.list.value_counts()` expression

Implemented in: #2902

[FEAT] Add a `list.contains` API

Hey folks, status? @raunakab

[FEAT] add register-table helper to sql-catalog

Hi, what's the intended use-case/ticket that this would address? cc @universalmind303 as well who is designing the overall story for SQL

There is no date on when the benchmark was executed

Hey @alberttwong ! Thanks for making this issue. Yeah unfortunately we're a pretty small team and don't quite have the capacity to be benchmarking often against the other frameworks 😭...

Update Ray tutorial to use Ray job submission method

Hmm interesting. I wasn't aware that they discouraged use of Ray client. We have noticed performance issues when using Ray client vs running in a job, but for the most...

Daft analytics timeout

Thanks @sagiahrac ! The client is *supposed* to be best-effort, we will take a look here.

Add support to translate `object_store` storage options to `daft.io.IOConfig`

> > @djouallah Looks like `allow_unsafe_rename` is an option that is used by delta-rs rather than object store. A workaround should be to set > > ``` > > export...

[FEAT] Add expressions for image height, width, channels and mode

Not prioritizing right now, no time... Closing.

ability to write to single parquet file

Just noting that this would be a departure from Spark behavior I believe, and would involve coalescing the data into 1 partition... Should we maybe add a kwarg like `single_file=True`...

ability to write to single parquet file

I think this might actually be much easier to support once we have the new local execution engine! -- Jay Chia Founder, Eventual ( https://www.eventualcomputing.com/ ) On Fri, Jun 21...