conformance icon indicating copy to clipboard operation
conformance copied to clipboard

enhancement: ability to list matching test cases and to show test suite and test case details

Open jhump opened this issue 1 year ago • 1 comments

Currently, all of the data associated with tests is embedded in the binary. But if a user wanted to explore the set of test cases, they have to go look at the source code in a git repository.

Ideally, the test runner's command-line interface would provide a way to list test cases, including filtering test cases against one or more patterns, and to show test case and test suite details.

jhump avatar Jun 14 '24 20:06 jhump

I would find this very useful, and it would alleviate https://github.com/connectrpc/conformance/issues/887. A simple solution could be to print all test names after the line Filtered tests to 123 test case permutation(s) with the --vv flag. That's not very discoverable, but maybe it's good enough to document it in configuring_and_running_tests.md and in the flag description.

timostamm avatar Sep 11 '24 11:09 timostamm