doris
doris copied to clipboard
[feature](parquet-reader) add delta bit pack decoder
Proposed changes
Support delta encoding, add delta bit pack decoder, add delta length byte array decoder, add delta byte array decoder.
We find some data type is read with delta encoding on AWS Glue, so it should be supported. The definition of delta encoding can refer to the delta encoding in parquet.
Problem summary
Describe your changes.
Checklist(Required)
- [ ] Does it affect the original behavior
- [ ] Has unit tests been added
- [ ] Has document been added or modified
- [ ] Does it need to update dependencies
- [ ] Is this PR support rollback (If NO, please explain WHY)
Further comments
If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...
run buildall
LGTM
wait for regression case
run buildall
run p0