object-store-python
object-store-python copied to clipboard
roeap
Python bindings and arrow integration for the rust object_store crate.
### Change list - Add async methods for each existing function. - Remove superfluous vec clone. `PyBytes::new(py, &Bytes::to_vec())` had two clones, I believe, where only one was needed. - [Automatically...
This should release the GIL and allow use in multiple threads. I tested with this script: ```python from contextlib import contextmanager import math from time import time from typing import...
Howdy, Love the bindings so far! Are there any plans to add support for [put_multipart](https://github.com/apache/arrow-rs/blob/master/object_store/src/lib.rs#L733)? Cheers
# What's going on: I am getting a panic error when trying to use this library to test against a localstack instance running inside a docker container. ## Minimal steps...
I first tested constructing an `ObjectStore` Python object to an s3 bucket on my local dev machine, but it didn't work out of the box because it wasn't able to...
In [`geoarrow-rs`](https://github.com/geoarrow/geoarrow-rs) I'm implementing parsers for geospatial file formats using object-store. I also have Python bindings, and it would be nice to reuse the builders in `object-store-python`, but I need...
- The underlying `get_opts` returns a [`GetResult`](https://docs.rs/object_store/latest/object_store/struct.GetResult.html). So _ideally_ it would be nice to return a Python object that wraps this `GetResult` so that in the future we could potentially...
In recent versions of object_store, [`parse_url`](https://docs.rs/object_store/latest/object_store/fn.parse_url.html) and `parse_url_opts` were added. This looks like it should significantly simplify the code in `builder.rs`. One drawback so far is that I can't tell...
Right now the `http` feature is not included https://github.com/roeap/object-store-python/blob/4f0454f24addb4508da7fb485bb55bf251accbb8/object-store/Cargo.toml#L13-L18 We should include the `http` feature as well; it should be low impact. This should be a small PR; I'll wait...