object-store-python
object-store-python copied to clipboard
Python bindings and arrow integration for the rust object_store crate.
The Rust crate this project is based on provides an async interface. However, this project provides a synchronous interface. Would it be possible to expose an async interface here (perhaps...
Hi @roeap I came here after reading this ticket on the arrow-datafusion-python repo. I have a question on the S3 ObjectStore and whether it is possible to pass ClientOptions struct...
Hi there @roeap! I really appreciate all the work you've done here. I was wondering a bit about the future of the project. Do you still plan on maintaining it...
Hello, thx for porting object-store to python! I'm facing this issue when trying to `.put('some-key', b'')` (empty object) to S3 storage, other sizes work ok: ``` Exception: Generic S3 error:...
Howdy, Is it possible to release a new version with the async changes to pypi? Cheers
is it possible to filter only _last_checkpoint , ideally without doing a full listing ? ``` import os from object_store import ObjectStore store = ObjectStore(table_path,storage_options) blobs = store.list('*/_delta_log/_last_checkpoint') print(*blobs, sep='\n')...
Howdy, I'm running into trouble installing the package either from pypi or github with pip in a Nix project. It looks like the issue is related to relative path references...
Branched off of https://github.com/roeap/object-store-python/pull/28 Here I am adding a new `stream` method to the `ObjectStore` class that returns a chunked stream over the bytes as an async iterator. Useful for...
Here I am adding some overrides for the async methods on the `ObjectStore` class so they are just as permissive with `PathLike` inputs as their sync counterparts. I also added...