Automated Test Selection Feedback

[codecovdesign]

Thanks for dropping by! 👋

We've been working out Automated Test Selection feature and would love your feedback.

• How was your experience setting up ATS with your repo?
• Did you experience any challenges?
• What did you think about the documentation?
• What would improve the set up process?
• How can ATS better help your team?
• Any general thoughts you'd like to share!

We greatly appreciate your time and thoughts - looking forward to hearing from you ❤

Codecov team

This issue is intended to share and collect feedback about the tool. If you have support needs or questions, please see our support page.

[shepherdjay]

@codecovdesign - So far I've actually not been able to utilize the feature. I enabled it on a low risk advent of code repo but it errored out specifically with this

/home/runner/work/_temp/b7fd63f0-da56-45ca-b23d-f3a1eebe35ed.sh: line 1: unexpected EOF while looking for matching `"'

Let me know if I should open a separate issue for this. It appears maybe there is a length issue when selecting the test as the command shown in the github actions is that it attempted to run as

Run pytest --cov=advent_of_code --cov-branch "--cov-context=test" "advent_of_code/2022/04/test_advent_04.py::test_check_overlaps[input0-True

Does not appear to be full test name and doesn't include a terminating quote.

[rohan-at-sentry]

@shepherdjay thanks for trying Automated test selection. I've referenced this in a new issue. Let's continue the discussion there https://github.com/codecov/codecov-ats/issues/30