rocketmq-flink icon indicating copy to clipboard operation
rocketmq-flink copied to clipboard

[#35] Use `LitePullConsumer` model instead of default pull consumer

Open galaxy077 opened this issue 3 years ago • 4 comments

close #35 Use DefaultLitePullConsumer model instead of default pull consumer.

Tips Thank you very much for contributing to Apache rocketmq-flink. What is the purpose of the pull request *solve some code about using defaultPullConsumer api

Brief change log (for example:)

*Modify RocketMQConfig.java RocketMQSourceFunction.java RocketMQSourceEnumerator.java RocketMQPartitionSplitReader.java RocketMQSourceTest.java

galaxy077 avatar Jul 24 '22 15:07 galaxy077

there are some problems about this code, like home to Use defaultlitPullConsumer to get offset and perform offset self-management

galaxy077 avatar Jul 25 '22 01:07 galaxy077

Codecov Report

Merging #46 (3f5fbe4) into main (90b00be) will increase coverage by 0.11%. The diff coverage is 5.15%.

@@             Coverage Diff              @@
##               main      #46      +/-   ##
============================================
+ Coverage     28.50%   28.62%   +0.11%     
  Complexity      164      164              
============================================
  Files            62       62              
  Lines          2529     2536       +7     
  Branches        269      269              
============================================
+ Hits            721      726       +5     
- Misses         1741     1743       +2     
  Partials         67       67              
Impacted Files Coverage Δ
...g/apache/rocketmq/flink/legacy/RocketMQConfig.java 0.00% <ø> (ø)
.../rocketmq/flink/legacy/RocketMQSourceFunction.java 9.80% <0.00%> (+0.24%) :arrow_up:
...g/apache/rocketmq/flink/source/RocketMQSource.java 0.00% <0.00%> (ø)
...nk/source/enumerator/RocketMQSourceEnumerator.java 0.00% <0.00%> (ø)
...nk/source/reader/RocketMQPartitionSplitReader.java 0.00% <0.00%> (ø)
.../apache/rocketmq/flink/common/RocketMQOptions.java 98.41% <100.00%> (+0.05%) :arrow_up:
...ource/table/RocketMQDynamicTableSourceFactory.java 68.18% <100.00%> (+0.73%) :arrow_up:
...mq/flink/source/table/RocketMQScanTableSource.java 27.27% <100.00%> (+0.95%) :arrow_up:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

codecov-commenter avatar Aug 28 '22 14:08 codecov-commenter

Thanks for @yiduwangkai updates. Could you please resolve the conflicts and squash the commits?

SteNicholas avatar Aug 30 '22 00:08 SteNicholas

Thanks, @yiduwangkai for your contributions. I left some comments, but I'm not familiar with rocketmq-flink, so please @SteNicholas help have a look.

zhouxinyu avatar Oct 11 '22 09:10 zhouxinyu

Since not all broker versions support lite pull, we need to clarify it in our doc.

zhouxinyu avatar Oct 26 '22 10:10 zhouxinyu