aws-ia
Mismatched region OR complete lack of named test gives no output at all
Describe the bug When a test profile and a region is specified on the command line and the test profile does not have the region in it's list, taskcat just exits with no output.
Since it is doing a validation which failed, it would be helpful to emit it as an error.
To Reproduce Steps to reproduce the behavior:
- Do a test run on a test and specify --region with a region that is not specified in the test definition in .taskcat.yml OR specify a test name that does not exist in .taskcat.yml
- Observe that it simply exits
Expected behavior An error that says that the CLI specified region does not match any of the regions specified in the test.
Screenshots If applicable, add screenshots to help explain your problem.
**Version (Please make sure you are running the latest version of taskcat)
- Taskcat Version (ex: [2018.817.210357])
Note: Python Version (python3 required)
To find versions:
Via taskcat: taskcat -V
Via pip3: pip3 show taskcat
Note: both version should match
To update taskcat run:
for docker : docker pull taskcat/taskcat
for pip3: pip3 install --upgrade taskcat
Additional context Add any other context about the problem here.
Per our separate discussion, the error messages and documentation around these scenarios should be improved.
