reporter icon indicating copy to clipboard operation
reporter copied to clipboard

Enable mixed run creation through command line, similar to automated runs

Open dnlstpnv opened this issue 4 months ago • 2 comments

Hi! Please, add support for creating a mixed run programmatically, without requiring interaction with the UI. Currently, it’s not possible to create a mixed run without using the UI. This limits automation and makes it harder to integrate mixed runs into scripts or CI/CD pipelines.

Now we can create mixed run without CI trigger, so I want to have possibility to create it from cli in CI, attach planId, or any another filter according to documentation. As a result of the command, I would prefer to see a typical response in the CLI:

 🤩 Testomat.io Reporter v2.2.2
Starting a new Run on Testomat.io...
[TESTOMATIO] Testomatio Reporter v2.2.2
[TESTOMATIO] Pipes: Testomatio Reporter
[TESTOMATIO] S3 credentials obtained from Testomat.io...
[TESTOMATIO] 📊 Report created. Report ID: 8264abe3
8264abe3

dnlstpnv avatar Aug 27 '25 12:08 dnlstpnv

Really good idea. We will do that!

DavertMik avatar Sep 04 '25 17:09 DavertMik

We will introduce --filter option to start command as you requested:

If we pass plan:

npx @testomatio/reporter start --filter="testomatio:plan=xxxx" =>

	Run <....> 
		plan_id=...
		kind: plan.kind (mixed, or manual, or automated, based on plan kind)

If we pass other filter:

We automatically create a plan:

npx @testomatio/reporter start --filter="testomatio:tag=xxxx" =>

	> grep 
		plan_id = Plan:
			generated: true
			plan_query: { tests: .... }
                        kind: autodetect (mixed if tests are auto & manual, manual if tests are manual only, etc)

	Run <....> 
		plan_id=...
		kind: plan.kind

And you will be able to combine start and run to create a run and then run only automated part of it:


npx @testomatio/reporter start --filter="coverage:....."


	> grep 
		plan_id = Plan:
			generated: true
			plan_query: { tests: .... }

		Run <....> 
			plan_id=...
			kind: autodetect



TESTOMATIO_RUN=xxx npx @testomatio/reporter run <command> --filter="testomatio:automated-tests-from-plan-attached-to-current-run"


TESTOMATIO_RUN=xxx npx @testomatio/reporter run <command> --filter="testomatio:run=xxx"

TESTOMATIO_RUN=xxx npx @testomatio/reporter run <command> --filter="testomatio:run"

DavertMik avatar Sep 09 '25 18:09 DavertMik