Daft
Daft copied to clipboard
Distributed DataFrame for Python designed for the cloud, powered by Rust
`--codecov` https://github.com/taiki-e/cargo-llvm-cov/pull/249
Hi folks, `Daft` is on track to become something really great. Do you have plans to support special types of `join`, like `rolling joins` and others described in the links...
Would apply a function on each element in the list Example: ``` df = daft.from_pydict({"a": [["HeLLo WoRlD", "Hi", "WelCoMe"], ["tO", "a New WoRlD"]]}) df.with_column("b", col("a").list.apply(element().str.lower())).select("b").show() ``` Expected output: ``` ╭─────────────╮...
Still would like something to check the size of a table before bringing it down the stream! Could we get the list you suggested? https://github.com/Eventual-Inc/Daft/pull/1558
`src/common/display`
Bumps [indexmap](https://github.com/indexmap-rs/indexmap) from 1.9.3 to 2.5.0. Changelog Sourced from indexmap's changelog. 2.5.0 Added an insert_before method to IndexMap and IndexSet, as an alternative to shift_insert with different behavior on existing...
**Is your feature request related to a problem? Please describe.** Add fp16 as a Daft type cc @conceptofmind
**Describe the bug** A clear and concise description of what the bug is. **To Reproduce** ```py df = (daft.from_pydict({ 'floats': [328.00, 327.00] }) .select(col('*'), col('floats').cast(daft.DataType.decimal128(15, 2)).alias('decimals_float')) .collect() .select(col('*'), col('decimals_float').cast(daft.DataType.float64()).alias('round_trip')) .collect()...
**Describe the bug** When I run stateful UDFs with GPU requests, I would require Daft to correctly assign each stateful UDF. For example, if my process starts with `CUDA_VISIBLE_DEVICES=3,4,5,6`, and...
https://github.com/Eventual-Inc/Daft/blob/d5b9a95a27fac14a916f3bbfffd8db0fdaaa8068/src/daft-schema/src/dtype.rs#L105-L107 imo should be `Struct(Arc)` for cheaper cloning assuming this is immutable