vizro icon indicating copy to clipboard operation
vizro copied to clipboard

[QA] Automatic vizro ai score tests

Open l0uden opened this issue 5 months ago • 0 comments

Description

  • Here I've added automatic reporting for any incoming prompt, by using parametrisation in logic function.
  • Now aggregated report for all runs can be found in Report-aggregated-* artifact in Integration tests for VizroAI workflow.
  • Also aggregated reports can now easily be found in artifactory for a longer period of time, because GitHub stores it maximum for 90 days. For the link please ping me directly.
  • To reduce amount of runs I've added flag workflow_dispatch. After merging branch to main it will be possible to trigger this workflow from GitHub UI

Notice

  • [x] I acknowledge and agree that, by checking this box and clicking "Submit Pull Request":

    • I submit this contribution under the Apache 2.0 license and represent that I am entitled to do so on behalf of myself, my employer, or relevant third parties, as applicable.
    • I certify that (a) this contribution is my original creation and / or (b) to the extent it is not my original creation, I am authorized to submit this contribution on behalf of the original creator(s) or their licensees.
    • I certify that the use of this contribution as authorized by the Apache 2.0 license does not violate the intellectual property rights of anyone else.
    • I have not referenced individuals, products or companies in any commits, directly or indirectly.
    • I have not added data or restricted code in any commits, directly or indirectly.

l0uden avatar Sep 13 '24 15:09 l0uden