delta-rs
delta-rs copied to clipboard
Features: Support needed
Projects seeking contributors
There are some useful features that need support to be implemented:
Delta features:
- Identity Columns
- Column Mapping
- Column alterations
- Deletion Vectors
- Shallow clone
- Read absolute paths
- v2 Checkpoints
- inCommitTimestamps
- Type widening
- Liquid clustering
- Variant Data Type
- Default Columns
- Domain Metadata
- VACUUM Protocol Check
- Row Tracking
Client features:
- Progress API
- ConfigKey Python
- Object Store caching layer
- Make z-order run on prefixed strings https://github.com/delta-io/delta-rs/issues/2844
See the sub-issue for each topic.
By type expansion you mean type widening? It might help to wait on that one until it's out of preview in the spec, it might change.
@hntd187 yes that's what I meant, ah I thought it was already GA. I'll update the description
ah I thought it was already GA
I believe type widening is GA in Databricks for some time now, but the actual Delta spec is not finalized yet.
It might help to wait on [type widening] until it's out of preview in the spec, it might change.
There is a PR https://github.com/delta-io/delta/pull/4094 open to finalize the Delta spec for the table feature, which will probably merge soon.