[Feature] Leverage the file index in lookup process to skip file

[Aitozi]

Search before asking

• [X] I searched in the issues and found nothing similar.

Motivation

During the Paimon lookup process, the local IO can be a bottleneck. It would be beneficial to utilize the file index to skip unnecessary file loading.

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

• [X] I'm willing to submit a PR!