execution-spec-tests icon indicating copy to clipboard operation
execution-spec-tests copied to clipboard

A Python framework and collection of test cases to generate test vectors for Ethereum execution clients

Results 183 execution-spec-tests issues
Sort by recently updated
recently updated
newest added

Currently, `gentest` generates test cases in the `blockchain_test` format. However, if a test case can be expressed as a `state_test`, `state_test` is the preferred format. This is because: - `fill`...

type:bug
scope:gentest

Add support to create `blockchain_test` tests cases. This idea will need some speccing out. A `blockchain_test` (consisting of one block) could potentially be created from a list of transaction hashes...

type:feat
scope:gentest

The `gentest` CLI currently has no test coverage - it could break at any time (perhaps due to changes in `ethereum_test_rpc`). While we can see whether we can also add...

type:test
scope:gentest

Currently, `gentest` only supports type 0 transaction types, which is quite limiting in a post-burn world :fire: We should add support for other types, prioritising type 2 transactions: - 0x2...

type:feat
scope:gentest

Currently, if a test module is generated via: ```bash uv run gentest -c config.json 0xa41f343be7a150b740e5c939fa4d89f3a2850dbe21715df96b612fc20d1906be tests/paris/test_0xa41f.py ``` the generated test module `tests/paris/test_0xa41f.py` doesn't pass the `flake8` and `mypy` checks when...

type:feat
scope:gentest

#850 consistently failed `tox_verify` with the Python 3.10 config in the test env with the following test: ``` =========================== short test summary info ============================ FAILED tests/cancun/eip1153_tstore/test_tstorage.py::test_run_until_out_of_gas[fork_Cancun-blockchain_test-tstore_wide_address_space] ============ 1 failed, 6232...

type:bug
scope:ci
scope:tooling

## 🗒️ Description Test how coverage script is working after refactoring Test vectors from PR: https://github.com/ethereum/execution-spec-tests/pull/680 Patches are introduced to the coverage script here, need to merge changes to the...

As the title suggest, we need to explore what is necessary for the BlockchainTest format to correctly support re-org testing.

Low prio. ![image](https://github.com/user-attachments/assets/1f97c89f-8591-4661-8823-c032949c1129)

type:bug
scope:docs

Replace `flake8`, `flake8-spellcheck`, `isort` and `black` with [`ruff`](https://github.com/astral-sh/ruff) and [`codespell`](https://github.com/codespell-project/codespell). Motivation: `ruff` is insanely fast. For the conversion, it won't be possible to maintain both systems side-by-side, as there are...

type:chore
scope:tooling