whylogs MLFlow integration: prediction monitoring

MLFlow integration: prediction monitoring

Open andyndang opened this issue 4 years ago • 6 comments

Breaking up #67.

Support monitoring python_function model deployments

https://www.mlflow.org/docs/latest/models.html#deploy-mlflow-models

The implementation takes in a Pandas dataframe - we should be able to ingest them into WhyLogs.

Will require:

Log rotation
Storage configuration for Production mode (versus using the model artifact backend in batch mode)

Oct 19 '20 15:10 andyndang

Is there any progression on this? I'd like to see an example of prediction monitoring using whylogs with MLflow.

Mar 02 '21 21:03 vochicong

Update on this:

We have log rotation
whylogs.yml is not being bundled in the MLflow deployment. This is the blocker at the moment

Apr 20 '21 16:04 andyndang