promptflow icon indicating copy to clipboard operation
promptflow copied to clipboard
verified publisher icon microsoft

[Contribution Request] Tutorial on Continuous Monitoring using ML Pipelines

Open loubigard opened this issue 1 year ago • 1 comments

Hi team, I would like to propose a tutorial about creating a pipeline for continuous monitoring. It describes an advanced use case of running flows in ML pipelines. Continuous monitoring is necessary to maintain the quality, performance and efficiency of Generative AI applications.
These factors directly impact the user experience and operational costs.

It will run evaluations on a basic chatbot flow, then aggregate the results to export and visualize the metrics. This contribution is a sharing from ISE Dragon Crew's CodeWith engagement. PR: #3644

loubigard avatar Jul 31 '24 08:07 loubigard

@loubigard thanks for the contribution! For your scenario, we recommend putting under integration folder. Let's discuss more in the PR.

D-W- avatar Aug 01 '24 02:08 D-W-

Merged in this PR: https://github.com/microsoft/promptflow/pull/3644

D-W- avatar Aug 21 '24 06:08 D-W-