iceberg
iceberg copied to clipboard
initial implementation of startsWith
Fixes https://github.com/Netflix/iceberg/issues/49
Initial implementation only for iceberg-api expressions
Open issues:
- should we add implementation for spark, parquet and avro?
- should we use case sensitive startsWith?
- should we support unicode characters startsWith?
@Liorba, thanks for working on this! This is a good start.
To answer your questions:
- Integrating engines to use startsWith can be done in a follow-up.
- I think this should be case sensitive.
- I'm not sure what you mean.
This also needs to update the project
methods in each transform. Otherwise, Iceberg wouldn't be able to convert STARTS_WITH data predicates to partition predicates.
@Liorba, thanks for updating, but this still needs to update the project
methods in each transform so Iceberg can convert these into partition predicates.
@Liorba, if you want to continue working on this, please re-open it in the apache/incubator-iceberg repository. That's the project's new home. Thanks!