QP Hou

The structure looks good to me :+1: When we introduce a proper expression handling abstraction, we should upgrade what we have in partition handling with it as well: https://github.com/delta-io/delta-rs/blob/cc62c49c905a0818e5d1edcd1383deb512dc2ac9/rust/src/partitions.rs#L12

Issue assigned, thanks @akbhuker for taking up on this!

It should support the the standard aws credential look up chain, we use it with iam role in AWS ecs tasks. The only missing support in the credential look up...

I agree this error message is very misleading. let's keep this issue open to track the improvement on the error message. There might be a way to match of the...

@zcking we use the default chain provider at https://github.com/delta-io/delta-rs/blob/649fdce8560251b1773d2f8dd578fa6bbe4a9834/rust/src/storage/s3/mod.rs#L443 So I think it should support the AWS_PROFILE env var? Can you perhaps try changing the profile you want to test...

I am thinking of releasing a new version of the python binding, @fvaleye do you want me to wait for this before doing the release?

@roeap I think that's something separate. We are currently still using passing the schema from rust to python through string ser/de, see https://github.com/delta-io/delta-rs/blob/5b2a09c59e1fa18f38c275475e41c2148ae02b5e/python/deltalake/schema.py#L153

do we know if the atomic rename in gen2 api is a cheap pointer change or will actually require data copy behind the scene? If it's the latter, we might...

Thanks for starting this discussion @thovoll . I think we should definitely have first class support for AMI due to production requirements. @thovoll does Azure sdk support the concept of...

Ha, I see where I am missing now. In AWS, it's common to use default credential chain in production, but looks like it's not the case in Azure. That said,...