sample-app-aoai-chatGPT icon indicating copy to clipboard operation
sample-app-aoai-chatGPT copied to clipboard

LLM Observability: Add optional Langfuse support

Open aiakubovich opened this issue 1 year ago • 1 comments

Hi! We use the AOAI app extensively, but it lacks LLM observability functionality. There should be an easy way to gather user interactions within the AOAI app. Langfuse is an open-source LLM observability platform that supports prompt logging. It offers native integration with OpenAI library which can be achieved by adding just a few lines of code to the underlying Python script. I am wondering whether it would be feasible to add optional Langfuse support into the AOAI app, as it seems that only minimal changes are required (a few variables for the Azure Web App and few lines in the AOAI app code). If this is ok, I can attempt to create a pull request for it.

aiakubovich avatar Jan 16 '24 10:01 aiakubovich

Was this done? I think it will be very useful because I havent see much on the logging aspect of the prompts and completions

rochaktarika123 avatar Apr 04 '24 13:04 rochaktarika123