execution-spec-tests
execution-spec-tests copied to clipboard
A Python framework and collection of test cases to generate test vectors for Ethereum execution clients
Currently, `gentest` generates test cases in the `blockchain_test` format. However, if a test case can be expressed as a `state_test`, `state_test` is the preferred format. This is because: - `fill`...
Add support to create `blockchain_test` tests cases. This idea will need some speccing out. A `blockchain_test` (consisting of one block) could potentially be created from a list of transaction hashes...
The `gentest` CLI currently has no test coverage - it could break at any time (perhaps due to changes in `ethereum_test_rpc`). While we can see whether we can also add...
Currently, `gentest` only supports type 0 transaction types, which is quite limiting in a post-burn world :fire: We should add support for other types, prioritising type 2 transactions: - 0x2...
Currently, if a test module is generated via: ```bash uv run gentest -c config.json 0xa41f343be7a150b740e5c939fa4d89f3a2850dbe21715df96b612fc20d1906be tests/paris/test_0xa41f.py ``` the generated test module `tests/paris/test_0xa41f.py` doesn't pass the `flake8` and `mypy` checks when...
#850 consistently failed `tox_verify` with the Python 3.10 config in the test env with the following test: ``` =========================== short test summary info ============================ FAILED tests/cancun/eip1153_tstore/test_tstorage.py::test_run_until_out_of_gas[fork_Cancun-blockchain_test-tstore_wide_address_space] ============ 1 failed, 6232...
## 🗒️ Description Test how coverage script is working after refactoring Test vectors from PR: https://github.com/ethereum/execution-spec-tests/pull/680 Patches are introduced to the coverage script here, need to merge changes to the...
As the title suggest, we need to explore what is necessary for the BlockchainTest format to correctly support re-org testing.
Low prio. 
Replace `flake8`, `flake8-spellcheck`, `isort` and `black` with [`ruff`](https://github.com/astral-sh/ruff) and [`codespell`](https://github.com/codespell-project/codespell). Motivation: `ruff` is insanely fast. For the conversion, it won't be possible to maintain both systems side-by-side, as there are...