Kyle Barron

Results 1646 comments of Kyle Barron

> does the Arrow PyCapsule interface provide a way to query for whether extracting the arrow data is a cheap operation? No it doesn't, but I think this largely comes...

> this will also require waiting for a DataFusion release based on Arrow 53, so I guess that could end up being a month later. Right. I would like to...

As an update here, lamentably arrow 53 supports StringView/BinaryView but **not** through C FFI, see https://github.com/apache/arrow-rs/pull/6368. So if you're restricted to using a released version of `arrow` (e.g. not a...

If you publish to crates.io, then yes, you can only use released versions. I might be able to get around this in arro3 specifically by vendoring the relevant parts of...

Arrow 53.1 was released, which appears to fully support string view and binary view: https://github.com/kylebarron/arro3/pull/219. I'd love to get this merged! Let me know if you need any help!

> Are there any blockers for you in updating to PyO3 0.22? Yes. I need the `numpy` crate to support 0.22, which should happen any day now: https://github.com/PyO3/rust-numpy/pull/442, https://github.com/PyO3/rust-numpy/pull/435. >...

> Ok, so I could remove the `arrow/pyarrow` feature flag and use these methods for the conversion back to pyarrow? Yep!

Looks like it's scheduled for Wednesday: https://github.com/PyO3/rust-numpy/pull/453

I published pyo3-arrow 0.5 using `pyo3` and `numpy` 0.22: https://crates.io/crates/pyo3-arrow

The minimum Python version does not need to be 3.11. You have three options: - use `abi3-py311` - Remove any `abi3*` flag - Take off the `buffer_protocol` feature flag with...