TestNG automation plugin

[atodorov]

Kiwi TCMS needs a customized plugin for TestNG which will record test execution results into our database

Getting started docs

• https://kiwitcms.readthedocs.io/en/latest/plugins/automation-frameworks.html
• https://kiwitcms.readthedocs.io/en/latest/contribution.html
• http://kiwitcms.org/blog/atodorov/2018/11/05/test-runner-plugin-specification/
• https://github.com/kiwitcms/junit-plugin
• https://testng.org/doc/documentation-main.html

Notes

• Sections 5.18 TestNG Listeners and 6.2.2 Logging Reporters seem to document what we need here. (see TestNG documentation above)

Definition of done

• a class named org.kiwitcms.testng.Reporter which extends the org.testng.IReporter interface and is similar to KiwiTcmsExtension/TestDataEmitter from our junit-plugin linked above
• very likely we'll have to abstract the reporting functionality in a separate class so that junit/testng reporters will only use a single entry point to that
• ^^^ work is created in a separate repository
• necessary changes are sent as pull requests to the junit-plugin repository
• README.rst contains information about installation & configuration
• repository can be packaged as a maven package (see junit plugin)
• repository contains tests
• repository uses GPLv3 license
• code review & issues reported from Kiwi TCMS maintainers have been resolved
• repository has been transferred under https://github.com/kiwitcms organization

Note: comment on this issue with a link to your repository as soon as you have something working!

This issue is part of Kiwi TCMS open source bounty program. For more information see the link(s) in bounty-program milestone

[atodorov]

Also see: https://github.com/kiwitcms/junit-plugin/issues/59

[atodorov]

See also TestNG XML format: https://testng.org/doc/documentation-main.html#logging-xml-reports

this is definitely easier to implement.

Can people who have upvoted this issue comment on the Java native vs. XML implementations. Are there any specific features which you use (or just generic reporting), etc. Kiwi TCMS team would like to have some more background info before we set off to build this plugin.

[abu-sithik]

Mostly we use generic reporting. Let me know if you need any further information.