seatunnel
seatunnel copied to clipboard
[Improve][Connector-V2] Improve Paimon source split enumerator
Purpose of this pull request Improve Paimon source split enumerator
Does this PR introduce any user-facing change? no
How was this patch tested? exists test
Check list
- [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
- [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/seatunnel/tree/dev/docs
- [ ] If you are contributing the connector code, please check that the following files are updated:
- Update change log that in connector document. For more details you can refer to connector-v2
- Update plugin-mapping.properties and add new connector information in it
- Update the pom file of seatunnel-dist
- [ ] Update the
release-note
.
cc @hailin0
Please add test case.
Please add test case.
Thanks for your review. I think this is an optimization of the existing PaimonSourceSplitEnumerator. Currently, pamion's test case can already cover it.
Could you implement stream read for paimon source ? I don't think this is necessary in batch read scenarios.
Could you implement stream read for paimon source ? I don't think this is necessary in batch read scenarios.
Ok, I'd be happy to do it.
@dailai