agenta
agenta copied to clipboard
Agenta-AI
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
Closes #1584
We aim to enhance the `agenta init` command to support a non-interactive mode, which would allow automation and integration into various workflows without the need for user intervention. This would...
- Now evaluators have access to whatever correct answer column from the testset.
## Description This PR proposes integrating observability into LLM applications with Agenta, even if the applications are not hosted on Agenta. ### Related Issue Closes [cloud_#338](https://github.com/Agenta-AI/agenta_cloud/issues/338) Relative [commons_#43](https://github.com/Agenta-AI/agenta-commons/pull/43) ### Additional...
## Description This PR allows litellm integration for observability. ### Related Issue Closes #1582 ### Additional Information The example demonstrating LiteLLM integration for observability is titled "litellm_integration". This example is...
* Make it larger * Give more space to the right part of the drawer * Improving the rendering of chat messages From [SyncLinear.com](https://synclinear.com) | [AGE-151](https://linear.app/agenta/issue/AGE-151/improve-trace-drawer-ui)
Some of the views we have right now are slow. We want to identify these, and identify the reason for these. Atlas/Newrelic can provide help there in profiling slow queries...
self-explanatory  From [SyncLinear.com](https://synclinear.com) | [AGE-167](https://linear.app/agenta/issue/AGE-167/add-inputs-and-outputs-as-optional-columns-in-the-trace-and-generation)
Currently only the following information is exported in the tracing and generation view: ``` variant,environment,status,created_at,latency,tokens,cost app.default,playground,OK,2024-04-28T19:09:15.735000Z,0.73,37,0.000063 app.default,playground,OK,2024-04-28T19:09:27.134000Z,0.736,37,0.000063 app.default,playground,OK,2024-04-28T19:09:30.456000Z,0.989,77,0.00013099999999999999 ``` We would like to add in addition to these the inputs...
The call to retrieve the configuration takes 1.20 seconds, indicating that 'get_config' is highly unoptimised. Here's the current process: * It fetches the base_id. * It checks permissions. * It...