Mahmoud Mabrouk

Currently you cannot run an LLM-as-a-judge unless your test sets happen to have a correct_answer column. Yet the LLM-as-a-judge does not need it. Correct behavior: It should be possible to...

[AGE-1840] Update First-Time Admin User Signup Experience in OSS

1

**Current Situation:** When a user first deploys Agenta open source, the first user to sign up becomes an admin user with exclusive rights to invite others to the platform. However,...

## Background Currently, the deployment guide instructs users to "Edit `hosting/docker-compose/oss/.env.oss.gh`." However, this file is not ignored by git, creating a security vulnerability where sensitive configuration values could be accidentally...

[AGE-1845] Incomplete Trace Information on Exceptions

1

**Description:** When Litellm encounters a failure, the provided trace information is insufficient. Specifically, the trace only shows an exception without detailing the entire request process. For instance, in a recent...

### Discussed in https://github.com/Agenta-AI/agenta/discussions/2512 Originally posted by **rpradal** March 4, 2025 Hello, I understand that I can specify my expected output on the app side when [fetching the prompt](https://docs.agenta.ai/prompt-management/quick-start#d-optional-schema-validation-with-pydantic). However,...

[AGE-2168] Newlines in prompts not recognized at commit time

1

@mmabrouk said: > Newlines in prompts are ignored at commit time 🧵 [af143f35-d897-40fb-b574-e908a70245fc](https://uploads.linear.app/514b189b-9687-46df-a5d7-242a42e958ea/c413d34f-c646-4ea7-8e97-1aa2b6b8e8c0/af143f35-d897-40fb-b574-e908a70245fc) From [SyncLinear.com](https://synclinear.com) | [AGE-2168](https://linear.app/agenta/issue/AGE-2168/newlines-in-prompts-not-recognized-at-commit-time)

[AGE-2166] Add Reset Password Functionality to Workspace UI

1

## **Overview** We want to add the reset password functionality in the UI under workspace settings. This will allow any user to reset passwords for users in their workspace. ##...

[AGE-1825] Can't get signed in for the first time after deploying agenta-oss

13

### Discussed in https://github.com/Agenta-AI/agenta/discussions/2539 Originally posted by **gerbpaul** March 20, 2025 @gerbpaul Thanks in advance for anyone that attempts to help me on this one! Everything appears to be installed...

We are using docusaurus. There is a draft implementation of a plugin that would enable this. [https://github.com/facebook/docusaurus/issues/10899](https://github.com/facebook/docusaurus/issues/10899) From [SyncLinear.com](https://synclinear.com) | [AGE-1858](https://linear.app/agenta/issue/AGE-1858/add-llmstxt-to-docs)

From [SyncLinear.com](https://synclinear.com) | [AGE-1851](https://linear.app/agenta/issue/AGE-1851/add-grok-xai-as-a-new-default-provider)