[AGE-433] [bug] New exact match and JSON evaluators are created with each served variant

[mmabrouk]

To reproduce:

• Create an app from cli (agenta init)

• Serve variant 1

• Create new code (app2.py) and serve variant2

  A new exact match and contains json evaluator will be created: https://share.cleanshot.com/QWVWKpFJ

  

Correct behavior:

• Exact match and contains json are only created when the app is initialized and not at each variant serve

_{From SyncLinear.com | AGE-433}

[Dozie2001]

Hello Interested in tackling this issue can I get more info

[mmabrouk]

Hi @Dozie2001 ,

It looks like the issue is here. Each time we create a new variant, we call create_ready_to_use_evaluators which creates these evaluators. However this should only be done when we create an app and now when we create a variant. The solution to call create_ready_to_use_evaluators when we create the app and not here and here. So it should happen here, hope this helps.

[mmabrouk]

I've assigned it to you @Dozie2001 let me know if that would work.

[Dozie2001]

Ok will get to it now

[mmabrouk]

I am closing this now, we will tackle it in a new issue related to the release