Daft

Daft copied to clipboard

Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.22 to 0.12.5. Release notes Sourced from reqwest's releases. v0.12.5 What's Changed Add http3 feature back, still requiring reqwest_unstable. Add rustls-tls-no-provider Cargo feature to use rustls without...

dependabot[bot]

Support for Arrow PyCapsule Interface

3

**Is your feature request related to a problem? Please describe.** The [Arrow PyCapsule Interface](https://arrow.apache.org/docs/format/CDataInterface/PyCapsuleInterface.html) is a new spec to simplify Arrow interop between compiled Python libraries. For example, you have...

kylebarron

Perform Stateful UDF initialization once-per-worker instead of once-per-partition

1

**Is your feature request related to a problem? Please describe.** Currently Stateful UDFs are initialized once per execution of a UDF, instead of once per worker initialization. This means that...

jaychia

**Is your feature request related to a problem? Please describe.** Decimal128 should support the summation aggregation ``` import daft df = daft.from_pydict({"foo": [1, 1, 2, 2, 3, 3]}) df =...

jaychia

Bumps [hyper](https://github.com/hyperium/hyper) from 0.14.27 to 1.4.1. Release notes Sourced from hyper's releases. v1.4.1 Bug Fixes http1: reject final chunked if missing 0 (8e5de1bb) v1.4.0 Bug Fixes http2: stop removing "Trailer"...

dependabot[bot]

Temporal docs added to expressions.rst

2

@jaychia @colin-ho Just added temporal doc section to expressions.rst. Let me know what you think of the content and then we can finalize which page or user-guide section to put...

sunaysanghani

Re: We should figure out a way to help folks remember to add our new expressions or dataframe methods into the docs. A CI step on our GitHub would be...

sunaysanghani

Do correct resource accounting if running multiple dataframe collections in the pyrunner

1

* Currently our pyrunner does not account for other dataframe collections that could be running in parallel. * Today our pyrunner spawns a threadpool for each collect / iter_partitions and...

samster25

Add Unity Catalog Volume support

3

It would be great to start building out Volume support from Daft for Unity Catalog. Images and JSON feel like the highest prio to start with. Right now Table supports...

avriiil

Defining a sampling distribution

10

I have parquet files divided into sub populations, I want to define a sampling distribution of the dataset to allow to sample from that distribution while training with pytorch. In...

GuyPozner