starrocks-connector-for-apache-flink
starrocks-connector-for-apache-flink copied to clipboard
[Enhancement] look function support partial cache
I found that the current connector supports the lookup function, but the implementation is to fully scan the table data and store it in the memory. If the table data is large, the memory usage of flink tm will be relatively high, and it may even be oom. I think we should support caching some data just like jdbc connector. Are there any plans to enhance the lookup function?
Would you like to contribute the feature?
I'm willing to implement this feature, but it will take some time.
I think it's ok, and first assign this issue to you. Thanks.
ok