agenta icon indicating copy to clipboard operation
agenta copied to clipboard

[Bug] unable to configure evaluators in docs

Open del-zhenwu opened this issue 7 months ago • 1 comments

Describe the bug unable to configure evaluators in docs To Reproduce

Image

Expected behavior what is registry/variant mean, has no evaluator as doc shows

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Smartphone (please complete the following information):

  • Device: [e.g. iPhone6]
  • OS: [e.g. iOS8.1]
  • Browser [e.g. stock browser, safari]
  • Version [e.g. 22]

Important Context Add context about the problem here.

  1. Network Logs in the Browser:

    • If applicable, Take a screenshot of the network logs or copy and paste any relevant log entries.
  2. Docker Containers Information:

    • If applicable, Provide a screenshot showing the list of running and stopped containers.
    • Please provide us the with a screenshot of the logs for the agenta-backend docker container.
  3. Additional Information:

    • Include any additional details, error messages, or observations that may be helpful.

Please make sure to provide all the requested information to expedite the debugging process. Thank you for helping us improve our project!


del-zhenwu avatar May 14 '25 08:05 del-zhenwu

Hello @del-zhenwu ,

Registry show the list of variants/version of your prompts/apps. The evaluator configuration are shown in the evaluation tab (see screenshot). Note that evaluation is only part of the cloud version of Agenta and are not part of the self-hosted version (see more detail here)

Image

mmabrouk avatar May 14 '25 09:05 mmabrouk