feast icon indicating copy to clipboard operation
feast copied to clipboard

Materializing subsets of features to the online store

Open niklasvm opened this issue 3 years ago • 1 comments

Is your feature request related to a problem? Please describe. Hosting an online store for a large number of entities and features can be very expensive. Materializing large data sets to the online store can also be expensive and time consuming.

My specific use case involves storing large data sets in parquet with feature views consisting of 1000s of features.

Currently all features in a feature view are materialized to the online store. Standard modelling practices usually involve training a model on the full set of features. A deployed model usually only relies on a subset of the original features. This means thats the online store ends up only serving subsets of features during inference.

Describe the solution you'd like Functionality to

  1. represent a subset of features either directly or through the use of feature services
  2. Only materialize this subset to the online store when calling feast materialize
  3. Default behaviour could be to still materialize all features ensuring backward compatibility

Describe alternatives you've considered None

Additional context Add any other context or screenshots about the feature request here.

niklasvm avatar Sep 08 '22 06:09 niklasvm

We've discussed this partially in the Feast Development Biweekly (https://docs.google.com/document/d/1zUbIWFWjaBEVlToOdupnmKQwgAtFYx41sPoEEEdd2io/edit#)

adchia avatar Sep 13 '22 15:09 adchia

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Jan 17 '23 00:01 stale[bot]