execution-spec-tests
execution-spec-tests copied to clipboard
feat(coverage): Enable coverage on any test change (rebased with uv)
🗒️ Description
Enable coverage script on any test .py files changes:
if no new lines in converted-ethereum-tests.txt, then seek for .py files with tests and compare the coverage from before and after PR, otherwise it compares the coverage from test repo and .py produced tests as before.
Script is reworked. use uv to run fill correctly remove retesteth to simplify the script use changed files github macro to detect changed files
🔗 Related Issues
Demo: https://github.com/ethereum/execution-spec-tests/pull/841 Rebase of: https://github.com/ethereum/execution-spec-tests/pull/707
✅ Checklist
- [x] All: Set appropriate labels for the changes.
- [x] All: Considered squashing commits to improve commit history.
- [ ] All: Added an entry to CHANGELOG.md.
- [x] All: Considered updating the online docs in the ./docs/ directory.
- [x] Tests: All converted JSON/YML tests from ethereum/tests have been added to converted-ethereum-tests.txt.
- [x] Tests: A PR with removal of converted JSON/YML tests from ethereum/tests have been opened.
- [x] Tests: Included the type and version of evm t8n tool used to locally execute test cases: e.g., ref with commit hash or geth 1.13.1-stable-3f40e65.
- [x] Tests: Ran
mkdocs serve
locally and verified the auto-generated docs for new tests in the Test Case Reference are correctly formatted.