paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[Feature] Leverage the file index in lookup process to skip file

Open Aitozi opened this issue 1 year ago • 0 comments

Search before asking

  • [X] I searched in the issues and found nothing similar.

Motivation

During the Paimon lookup process, the local IO can be a bottleneck. It would be beneficial to utilize the file index to skip unnecessary file loading.

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

  • [X] I'm willing to submit a PR!

Aitozi avatar Jul 25 '24 07:07 Aitozi