agenta icon indicating copy to clipboard operation
agenta copied to clipboard

[AGE-452] [bug] create_new_evaluator_config not setting default correct_answer value

Open mmabrouk opened this issue 1 year ago • 2 comments

Creating new evaluator configurations programatically fails unexpectedly. The reason is that in the default call, the correct_answer value is set to None instead to the default correct_answer.

response = self.client.evaluators.create_new_evaluator_config(
            app_id=app_id,
            name=name,
            evaluator_key="auto_webhook_test",
            settings_values={"webhook_url": webhook_url},
        )

We should either set the value per default to correct_answer (in the SDK, or in the backend if set to None), or raise an Exception if the call is done without providing a correct answer value.

Context for the bug

From SyncLinear.com | AGE-452

mmabrouk avatar Jul 19 '24 17:07 mmabrouk

Hi @mmabrouk , I wanted to work on this issue. Can you assign it to me.

bilalqv avatar Aug 04 '24 13:08 bilalqv

That's great. Done!

mmabrouk avatar Aug 05 '24 19:08 mmabrouk