Daft icon indicating copy to clipboard operation
Daft copied to clipboard

Distributed DataFrame for Python designed for the cloud, powered by Rust

Results 272 Daft issues
Sort by recently updated
recently updated
newest added

`--codecov` https://github.com/taiki-e/cargo-llvm-cov/pull/249

Hi folks, `Daft` is on track to become something really great. Do you have plans to support special types of `join`, like `rolling joins` and others described in the links...

enhancement

Would apply a function on each element in the list Example: ``` df = daft.from_pydict({"a": [["HeLLo WoRlD", "Hi", "WelCoMe"], ["tO", "a New WoRlD"]]}) df.with_column("b", col("a").list.apply(element().str.lower())).select("b").show() ``` Expected output: ``` ╭─────────────╮...

enhancement

Still would like something to check the size of a table before bringing it down the stream! Could we get the list you suggested? https://github.com/Eventual-Inc/Daft/pull/1558

Bumps [indexmap](https://github.com/indexmap-rs/indexmap) from 1.9.3 to 2.5.0. Changelog Sourced from indexmap's changelog. 2.5.0 Added an insert_before method to IndexMap and IndexSet, as an alternative to shift_insert with different behavior on existing...

dependencies
rust

**Is your feature request related to a problem? Please describe.** Add fp16 as a Daft type cc @conceptofmind

**Describe the bug** A clear and concise description of what the bug is. **To Reproduce** ```py df = (daft.from_pydict({ 'floats': [328.00, 327.00] }) .select(col('*'), col('floats').cast(daft.DataType.decimal128(15, 2)).alias('decimals_float')) .collect() .select(col('*'), col('decimals_float').cast(daft.DataType.float64()).alias('round_trip')) .collect()...

bug

**Describe the bug** When I run stateful UDFs with GPU requests, I would require Daft to correctly assign each stateful UDF. For example, if my process starts with `CUDA_VISIBLE_DEVICES=3,4,5,6`, and...

https://github.com/Eventual-Inc/Daft/blob/d5b9a95a27fac14a916f3bbfffd8db0fdaaa8068/src/daft-schema/src/dtype.rs#L105-L107 imo should be `Struct(Arc)` for cheaper cloning assuming this is immutable