[Feature] Support lance file format

[coolderli]

Search before asking

• [X] I searched in the issues and found nothing similar.

Motivation

Lance format provides better support for machine learning. It can better support point lookup and wide columns to support vectorized data storage.

Do we have a plan to support this file format? Can you share your thoughts? Thanks. @JingsongLi @SteNicholas

https://lancedb.github.io/lance/format https://blog.lancedb.com/lance-v2/

Solution

Support lance file format for vectorized data storage.

Anything else?

No response

Are you willing to submit a PR?

• [X] I'm willing to submit a PR!