agenta
agenta copied to clipboard
[AGE-452] [bug] create_new_evaluator_config not setting default correct_answer value
Creating new evaluator configurations programatically fails unexpectedly. The reason is that in the default call, the correct_answer value is set to None instead to the default correct_answer.
response = self.client.evaluators.create_new_evaluator_config(
app_id=app_id,
name=name,
evaluator_key="auto_webhook_test",
settings_values={"webhook_url": webhook_url},
)
We should either set the value per default to correct_answer (in the SDK, or in the backend if set to None), or raise an Exception if the call is done without providing a correct answer value.
From SyncLinear.com | AGE-452
Hi @mmabrouk , I wanted to work on this issue. Can you assign it to me.
That's great. Done!