maestro icon indicating copy to clipboard operation
maestro copied to clipboard

add new test report format: HTML

Open depapp opened this issue 1 year ago • 4 comments

Proposed Changes

My team and I - @fitriahfebriani @dhanifatima @akbarb83 - are working on creating a new test report format using HTML. This feature was also requested in the GitHub issue and Slack channel:

  • #1067
  • https://mobile-dev-inc.slack.com/archives/C041FU72T54/p1715878948428049
  • https://mobile-dev-inc.slack.com/archives/C041FU72T54/p1701735074875579
  • https://mobile-dev-inc.slack.com/archives/C041FU72T54/p1685948905248809?thread_ts=1684996029.957359&cid=C041FU72T54

Testing

To use the HTML test report: maestro test --format html flow.yaml

Test Report

  • The test report is available in the /Users/user/.maestro/tests/*/report.html directory

Maestro - HTML Test Report html

depapp avatar May 20 '24 02:05 depapp

@depapp thanks to you and the team for taking the time to work on an HTML report generation! Did you consider using something like Allure for the rendering instead of building the reporting from scratch?

axelniklasson avatar May 20 '24 11:05 axelniklasson

@depapp Nice idea and congrats for the work! I was working on that too the last week 🚀

Screenshot 2024-05-13 alle 13 06 55 Screenshot 2024-05-13 alle 13 07 24

ludovicobesana avatar May 20 '24 15:05 ludovicobesana

@depapp thanks to you and the team for taking the time to work on an HTML report generation! Did you consider using something like Allure for the rendering instead of building the reporting from scratch?

hi @axelniklasson thanks for your feedback,

using Allure is a great idea. but I think we could implement it as an additional format option in a separate Pull Request, so the command looks like --format allure, so there would be three options available:

  • junit
  • html
  • allure

this would be similar to other automation tools.

depapp avatar May 21 '24 01:05 depapp

@depapp Nice idea and congrats for the work! I was working on that too the last week 🚀

hi @ludovicobesana 👋🏻

it's great to hear that you were working on this as well. let's collaborate and combine our efforts to make the HTML report feature even better. 🚀

depapp avatar May 21 '24 01:05 depapp

hi @axelniklasson could you please assist with re-reviewing the changes thanks

updated report: image

depapp avatar May 24 '24 07:05 depapp

A couple of nits regarding copy but apart from that it's looking great! 🙌

thanks @axelniklasson 🙇🏻 I will update the documentation soon as well

depapp avatar May 24 '24 10:05 depapp

Thanks for this contribution @depapp 🙏 Please tag me in the docs PR when you've raised it.

axelniklasson avatar May 24 '24 12:05 axelniklasson

@depapp thanks to you and the team for taking the time to work on an HTML report generation! Did you consider using something like Allure for the rendering instead of building the reporting from scratch?

hi @axelniklasson thanks for your feedback,

using Allure is a great idea. but I think we could implement it as an additional format option in a separate Pull Request, so the command looks like --format allure, so there would be three options available:

  • junit
  • html
  • allure

this would be similar to other automation tools.

Do you have any open issue for this ?

er-anupamkumar avatar May 14 '25 09:05 er-anupamkumar