epic: Initialize Playwright for basic run and dashboard report

[Van-QA]

trafficstars

Motivation

• Implement automation runs to reduce manual regression testing efforts.
• Shift focus during each release to investigating and troubleshooting potential issues.
• Minimize the need for repetitive manual testing across multiple operating systems.

Specs

• Apply structure to automation script using Playwright Framework
• Intergrate with Report Portal to collect logs for troubleshooting.

Designs

Reporters

Tasklist

• [x] #1936
• [x] #1937
• [x] #2045
• [x] #2047

Not in Scope

Appendix

[freelerobot]

How do we measure performance degradation/improvements as a part of this?

We get anecdotal reports of slow down / speed up. How do we get concrete visibility?

[Van-QA]

hi @0xSage,

This is only for automation regression testing purposes and will run side-by-side / independently from the Jan app (using the Github Action pipeline / workflow). Automation runs like this have no impact on the main Jan app, it's like additional checks (similar to how we ran an antivirus check on a new build), and the officially released Jan app will not be related to the automation test in any way. The test will cover critical functions to highlight breaking changes in the report, we will not measure performance at this stage.