Ritchie Vink

Thanks @flisky

Arrow2 doesn't support it directly, but it can be implemented by libraries that use arrow2. For instance polars supports it and uses arrow2 for parquet reading.

Ah, given that you also maintain `halfbrown`, maybe doing that upstream is nicest. Would a halfbrown based on `IndexMap` be worth it? For me a feature flag would be fine....

Great! Thanks for being receptive to this. :) For #377, I need a little bit more context. :sweat_smile: What does it do? What is the semantic difference between a borrowed...

The `dtype` of `list.to_struct` cannot be known statically and therefore requires a user to provide a dtype. We must add that option.

In the mean time you can add a cast to inform Polars of the type.

Could you share an example file that contains these?

> Also which pyarrow version did you use here? Pyarrow 16 > Can you check with delta_write_options = {"engine":"rust"}? This should at least run, but it will probably cast utf8_view...

I am not convinced by this one. Two things I am concerned about. - New dependencies and binary size. (Can you check how much this increments by the new dependencies)...

Alright. Let's give this a try. I understand why this can be nice. Thank you @CanglongCl