OpenHands icon indicating copy to clipboard operation
OpenHands copied to clipboard

Automate regression test checking

Open anasdorbani opened this issue 1 year ago • 3 comments

  • This is related to #269 issue

anasdorbani avatar Mar 28 '24 05:03 anasdorbani

if you execute run.py this would be the result so now we need to have more structured way to handle tests image

anasdorbani avatar Mar 28 '24 22:03 anasdorbani

This looks awesome!

Do the bash and python do the same thing? I'd rather only maintain one if so, and python seems much better for the task.

I do think we'll need to be able to output the results to YAML/JSON for any post processing (e.g. failing CI/CD)

rbren avatar Mar 29 '24 00:03 rbren

the result that you see was built using python, the bash script was just the first version I will try to remove it after trying to make an architecture for the regression framework

anasdorbani avatar Mar 29 '24 00:03 anasdorbani

Closing this one in favor of the more recent one @dorbanianas put together

rbren avatar Mar 29 '24 14:03 rbren