starrocks-connector-for-apache-flink icon indicating copy to clipboard operation
starrocks-connector-for-apache-flink copied to clipboard

Published 20 hours ago • verified publisher icon StarRocks

support load data from starrocks table by specific condition

Open billowsoft opened this issue 11 months ago • 1 comments

https://github.com/StarRocks/starrocks-connector-for-apache-flink/blob/08de67ad0f5c3cd9fbc3707466df6c642dfee7e7/src/main/java/com/starrocks/connector/flink/table/source/StarRocksDynamicLookupFunction.java#L99

Current implementation is loading all the data of the table which will cause OOM while the the data volume is too big, suggest can support load data by specific condition, just like org.apache.flink.connector.jdbc.table.JdbcLookupFunction

billowsoft avatar Mar 22 '24 10:03 billowsoft

@billowsoft You mean it's no way to specify the condition? cc @banmoy

jaogoy avatar Apr 10 '24 02:04 jaogoy