Data quality monitoring

[adchia]

This is tracking work related to Feast RFC-027: Data Quality Monitoring

[TremaMiguel]

@adchia I think you could take as example LightGBM Feature Request Tracking to keep track of issues related to DQM.

• [ ] Issue 4329
• [ ] Issue 1211
• [x] Issue 1980
• [x] Issue 1515
• [ ] Issue 9760

In this way, new contributors could know how he/she can contribute.

[franciscojavierarceo]

are there tickets tracking the work here? i was interested in contributing to this area but wasn't sure which milestone @pyalex was working on

[adchia]

I think there's actually not too much active work happening right now. @chhabrakadabra is going to also beginning thinking about this a lot soon, but right now still very much in the phase of figuring out what makes sense to build.

We are working on improving documentation at least of what is already supported! (i.e. validating served features in the Go feature server, validating training datasets against a reference data set, using feast validate)

[franciscojavierarceo]

what would be the best way to contribute in that case? would love to collaborate @chhabrakadabra

i spoke with the team earlier and heard there was interest in integrating with great expectations and i think that makes a lot of sense, i think there's also some other ideas i have that i'd like to incorporate

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.