Abram

Results 45 comments of Abram

> ☝️ requires fixing ? Nope, it doesn't.

> This can't go to QA until we fix the issue whereby the LLM doesn't respond in numeric format anymore. -- @mmabrouk @aybruhm It works now, and I didn’t change...

**QA Report:** https://agenta-hq.slack.com/archives/C05JT3NQB1R/p1724832222331489?thread_ts=1724757298.386189&cid=C05JT3NQB1R

**QA Report:** https://agenta-hq.slack.com/archives/C05JT3NQB1R/p1724833122715339?thread_ts=1724757298.386189&cid=C05JT3NQB1R

> Thanks @aybruhm, quick question 👇 Shouldn't this apply to all non-RAG evaluators (not just `contains_json`) ? We already are doing that. The `contains_json` evaluator requires that the value of...

@jp-agenta, as per our discussion, the PR has been updated. Here’s a preview of what it looks like: ![image](https://github.com/user-attachments/assets/220e3d29-0787-4728-8b67-8c257d28901a)

### Failing CLI Command Tests / Serve-to-OSS: The failing test is due to a missing schema migration in OSS production. ![image](https://github.com/user-attachments/assets/97c03149-aadc-40c9-853d-b9e89f1f7907) ### CLI Commands Working Locally: ![image](https://github.com/user-attachments/assets/be81a0fa-4402-41e0-acca-f94210999e49) ### Next Steps:...

> What is the QA status for this? PR description updated with acceptance tests, and have been handed over to @zenUnicorn for QA.

> @aybruhm It is expected that the oss tests fail here, since they are using the old backend hosted in oss.agenta.ai (which expects `Dockerfile` and not `Dockerfile.agenta.oss`) Ah, got it....