app Choose to rerun

Feature Request: Enhanced Rerun Options for Test Runs

Problem Description

Currently, the rerun options in Testomatio are limited to predefined choices:

Relaunch Failed on CI
Relaunch All on CI
Relaunch Manually
Launch a Copy Manually

These options do not cater to the following use cases:

The need to selectively rerun specific tests (e.g., passed, skipped, failed, or tests without a status).
The inability to provide new inputs or modify automated test run configurations before triggering a rerun.
Handling situations where test results remain in a pending state due to CI failures, resulting in a dead end with no possibility of rerunning.
The lack of flexible rerun options for manual test runs.

Proposed Solution

Checkbox Selection for Rerun
- Add checkboxes next to each test in a test run (similar to the checkboxes available on the "Test Runs" page or the "Tests" page). They should be available on each filtered view for better UX
- Allow users to select individual tests for rerun.
Enhanced Rerun Popup with Configurable Options
- Once tests are selected, provide a "Rerun" button that opens a popup with the following options:
  - Rerun as a Copy: Create a new test run containing only the selected tests. The new test run should be placed alongside the original in the same folder.
  - Rerun in Place: Rerun the tests within the existing test run ID.
- Input Configuration: Allow users to view and modify inputs for the rerun (e.g., environment, CI configuration, etc.).
  - Default inputs should mirror those used in the original run.
  - Enable users to update inputs if necessary before rerunning.
Support for All Test Statuses
- Ensure that rerun functionality supports tests in all statuses (passed, skipped, failed, pending or without status).
Manual Test Runs
- Extend the "Choose to Rerun" functionality to manual test runs, allowing similar flexibility in selecting and rerunning tests.

Additional Benefits

Users can customize reruns to better align with their workflows.
Simplifies workflows for handling CI failures and manual test reruns.
Reduces the need for repetitive test runs or manual setup when rerunning tests.

Let me know if further refinement is needed or if you'd like me to expand on specific aspects!

Current UI

Dec 11 '24 14:12 tikolakin

Dec 13 '24 23:12 poliarush

@Fro0z1k we need to make flexible rerun configurator to:

re-launch automated / manual tests with config
- how to update results: copy as new run or update to existing run
- define a name if it's a copy
- select tests by 1) status, priority, defects presence 2) or/and select tests by manual selection or 2) select tests by TQL
- what environment is used: previous or new
- what assignees are used: previously selected for tests or new assignee strategy
- where to run if automated: choose existed or new CI configuration

@xevgeniy-ellinskiyx come up with design options

Mar 28 '25 18:03 poliarush

make it with sidebar

Mar 31 '25 12:03 TetianaKhomenko

send run title, tests, checkbox to create new run

Apr 02 '25 14:04 TetianaKhomenko

passing to @littlefrontender for further UI development

Apr 09 '25 12:04 TetianaKhomenko

Hi @tikolakin! Thanks for the feature request. Here is a short demo video of the feature implementation. It will be included in the upcoming release

https://github.com/user-attachments/assets/784901ff-3def-4286-a387-b207087749c5

Apr 24 '25 15:04 TetianaKhomenko

Thanks @TetianaKhomenko , the demo on the recording looks really good Looking forward to try it out

Apr 24 '25 15:04 tikolakin

Hi @TetianaKhomenko Could you have a look at this point from the original description?

The lack of flexible rerun options for manual test runs.

In the latest implementation for manual (possible mixed test runs?) test runs there is still no option to chose test cases to rerun

Also I am not sure about "Advanced" part of this option. I am not sure how to communicate it to the team. As to rerun test they need to use advanced option..... There is nothing advanced, can it be a simple relaunch?

It's a very obvious use case that happens every day every testing cycle. Can we call it "Choose to rerun" or similar. It should be call to action

Apr 29 '25 06:04 tikolakin

Hi! Thanks for pointing this out! Indeed now this option is available for CI relaunch only. We plan to expand this feature to include manual tests as well.

Apr 29 '25 08:04 TetianaKhomenko

@Fro0z1k needed for manual and mixed runs as well

Apr 30 '25 12:04 TetianaKhomenko

Hi @tikolakin ! Thanks for the feature request. The feature for manual/mixed runs was implemented. Here is a short video guide.

https://github.com/user-attachments/assets/2ccbf709-a4df-43ea-9217-ad235a95ef88

May 16 '25 10:05 YanaBaranova0909

@xevgeniy-ellinskiyx are fine with this screen ?

May 18 '25 13:05 poliarush

described here https://docs.testomat.io/project/runs/managing-runs/#advanced-relaunch

Aug 16 '25 18:08 TetianaKhomenko