Arrow uint32/64 support

[hugokitano]

trafficstars

Is your feature request related to a problem or challenge?

iceberg::spec::Schema::try_from tries to construct an Iceberg schema from an arrow schema, but does not support converting uint types.

Describe the solution you'd like

ArrowSchemaVisitor::primitive must support uint types, currently throws Error: DataInvalid => Unsupported Arrow data type: UInt64

Willingness to contribute

None

[zuston]

Nice catch. But I think the iceberg spec's primitive type haven't supported this unsigned type. cc @liurenjie1024

If having any solution, I can take this ticket to be as my first PR

[hugokitano]

I would appreciate! Currently blocking for my use case

[liurenjie1024]

Thanks @hugokitano for raising this. Iceberg has no support for non negative data types, I think user can convert them to corresponding signed data types before writing?

[jonathanc-n]

Is there a reason we do not support unsigned integers?

[liurenjie1024]

Is there a reason we do not support unsigned integers?

The spec defined data type supported.

[github-actions[bot]]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[liurenjie1024]

I think this issue is still valuable to discuss.

[kszlim]

It'd be very nice to have the spec support this, especially since parquet/arrow have native support. It's unfortunate that we're held back by the java origins of iceberg.

[liurenjie1024]

I think this is also missing in java implementation. We should raise a discussion in dev list.

[kszlim]

Yeah, probably because java doesn't natively have unsigned ints 😔