ExampleGens for various OSS feature stores (Feast, etc)

[theadactyl]

[rcrowe-google]

• Should it be a general component, or specific to individual feature stores?
• Would be useful to have an abstraction layer to generalize it
• Stretch goal: Unified interface
• Stretch goal: Structuring for later work to write data to feature store
• Project Team: Badrul Chowdhury, Michal Brys

[BACtaki]

Here is a draft proposal, looking forward to your thoughts @rcrowe-google, @theadactyl and others: https://drive.google.com/file/d/1SjSxiXC9Q_OJYzFDXqp2sQbwUM_HdrRu/view?usp=sharing

TODO Find and describe a concrete use case for reading from Feast in more detail TODO Add more implementation details with diagram TODO Find and describe a concrete use case for writing to Feast

[rcrowe-google]

Interesting! Originally this idea was just about reading data from a feature store, so the MLMD integration is an interesting twist. I've reached out to see if I can get some concrete use cases.

[rcrowe-google]

On this part:

Releases

The project will be packaged and released as part of MLMD.

There are some issues with that. It's better to plan to package and release this separately.

It would also be good to discuss in this proposal what kinds of artifacts would be stored in MLMD. For example:

• The name of the feature set?
• The query used?
• Online or offline data?

[rcrowe-google]

Proposal being reviewed by Google team