agenta
agenta copied to clipboard
Agenta-AI
The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
- Add an explanation in the advanced tutorial how to consume prompts/configurations from agenta without using the deployment - Create examples for this
Let's add the new commands to the CLI reference under docs/developer_guides/cli Branch: docs_v2
- [x] @mmabrouk Write scaffold docs - [x] @devgenix Continue missing part in docs/advanced_guides/using_agenta_from_cli.mdx - [ ] @mmabrouk Edit draft
The quickstart tutorial is outdated. - [ ] add step for comparing two variants side-by-side (create a new variant, change parameters, compare side by side) with screenshots - [ ]...
We would like to add the possibility to create a new variant based on a configuration from CLI. `agenta config add base_name.config_name.toml` -> adds a new variant based on base_name.py...
**Is your feature request related to a problem? Please describe.** We would like to be able to manage and create test sets from CLI ``` agenta testset agenta testset list:...
**Describe the bug** When serving a variant with code that fails to execute (e.g., due to a syntax error in Python), it leads to the deployment being set to null....
**Summary** - Users want a better way to do annotations in Agenta. We'll make it more flexible for setting up annotation jobs. **Description** - Right now, our system doesn't let...
Each evaluator we create (except the ready-to-use ones) has some settings. However, creating an evaluation and navigating to the corresponding scenarios doesn't display the settings of the evaluators. Such info...
