execution-spec-tests icon indicating copy to clipboard operation
execution-spec-tests copied to clipboard

feat(coverage): check patched tests coverage [TEST]

Open winsvega opened this issue 7 months ago • 0 comments

🗒️ Description

Enable coverage script on any test .py files changes:

if no new lines in converted-ethereum-tests.txt, then seek for .py files with tests and compare the coverage from before and after PR, otherwise it compares the coverage from test repo and .py produced tests as before.

🔗 Related Issues

✅ Checklist

  • [x] All: Set appropriate labels for the changes.
  • [x] All: Considered squashing commits to improve commit history.
  • [x] All: Added an entry to CHANGELOG.md.
  • [x] All: Considered updating the online docs in the ./docs/ directory.
  • [x] Tests: All converted JSON/YML tests from ethereum/tests have been added to converted-ethereum-tests.txt.
  • [x] Tests: A PR with removal of converted JSON/YML tests from ethereum/tests have been opened.
  • [x] Tests: Included the type and version of evm t8n tool used to locally execute test cases: e.g., ref with commit hash or geth 1.13.1-stable-3f40e65.
  • [x] Tests: Ran mkdocs serve locally and verified the auto-generated docs for new tests in the Test Case Reference are correctly formatted.

winsvega avatar Jul 11 '24 10:07 winsvega