Robert Pack

Results 141 comments of Robert Pack

are you using the python APIs, or the rust API directly.

@kesavkolla, thanks for the PR!. There is a few more adjustments needed though. We also need to update ci/cd as in the new version the gcs client no longer uses...

exactly, right now we use the github action integration for running services right now. However this does not have an option to pass in alternative args. So we have to...

In delta-rs I have been playing around with some of this, in the hopes to eventually get to a point to move this upstream into object store. Specifically, I took...

We welcome all contributions, large and small - my assumption this would fall well in the former category 🙂. I only skimmed the design docs, but it seems we will...

@joshuarobinson with the release of 0.6.1 we now - whenever possible - reuse the same backend store also in the read path. Could you check if that works for you?

Agreed! Also very much looking forward to all the dependencies we a re going to loose :) - the AWS migration already landed, and Azure is on its way (apache/arrow-rs#2509)....

With the adoption of `object_store`, the datafusion integration now supports all storage backends - there are integration tests as well :). https://github.com/delta-io/delta-rs/blob/main/rust/tests/integration_datafusion.rs

With the adoption of `object_store`, we now use the blob api throughout, which is supported by Gen1 and Gen2 accounts. We do retain the if_not_exists functionality of course :).