paimon icon indicating copy to clipboard operation
paimon copied to clipboard
verified publisher icon apache

[flink] Support cache lookup operator in flink

Open FangYongs opened this issue 1 year ago • 3 comments

Purpose

Linked issue: close #3521

Support flink cache lookup operator

Tests

Added test case LookupJoinITCase#testLookupTableWithCache

API and Format

no

Documentation

no

FangYongs avatar Jun 15 '24 02:06 FangYongs

Hi @FangYongs , can you explain why we should use flink cache? Any performance benifits?

JingsongLi avatar Jul 05 '24 14:07 JingsongLi

@JingsongLi We want to reuse metrics in flink job such cache hits and misses, and we will add more metrics such as qps/latency in flink lookup operator. WDYT?

FangYongs avatar Jul 11 '24 12:07 FangYongs

@JingsongLi We want to reuse metrics in flink job such cache hits and misses, and we will add more metrics such as qps/latency in flink lookup operator. WDYT?

Add more metrics to paimon lookup function looks good to me~

JingsongLi avatar Jul 12 '24 07:07 JingsongLi

Close this now, we can just add more metrics.

JingsongLi avatar Aug 12 '24 02:08 JingsongLi