flink-connector-elasticsearch icon indicating copy to clipboard operation
flink-connector-elasticsearch copied to clipboard

[FLINK-25568] Support Elasticsearch Source Connector

Open kaori-seasons opened this issue 1 year ago • 5 comments

According to FLIP-127 to achieve source read function

kaori-seasons avatar May 10 '23 06:05 kaori-seasons

Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html)

boring-cyborg[bot] avatar May 10 '23 06:05 boring-cyborg[bot]

Support for FilterPushDown, ProjectPushDown, and LimitPushDown to optimize query performance. Have these functions been implemented? I don't seem to have seen this part of the code

WenDing-Y avatar May 12 '23 07:05 WenDing-Y

Support for FilterPushDown, ProjectPushDown, and LimitPushDown to optimize query performance. Have these functions been implemented? I don't seem to have seen this part of the code

Hello, I am very happy to read your comments. Currently this PR belongs to draft status. For the three push-downs you mentioned. As shown in FLIP-127, I am going to implement related implementations of FilterPushDown, ProjectPushDown, and LimitPushDown and optimize es query expressions. Currently, only the ProjectPushDown interface is implemented, please refer to Elasticsearch7DynamicSource#applyProjection.

Due to busy work, I will finish the development after a while.

kaori-seasons avatar May 12 '23 09:05 kaori-seasons

@kaori-seasons Are you still planning to work on this PR?

MartijnVisser avatar Oct 24 '23 07:10 MartijnVisser

@kaori-seasons Are you still planning to work on this PR? @MartijnVisser Hello, I just saw your reply recently. Due to work, I did not continue this Pull request. I will start to resolve the conflict this month and request a review.

kaori-seasons avatar Dec 10 '23 13:12 kaori-seasons