evmone icon indicating copy to clipboard operation
evmone copied to clipboard

Check execution-spec-tests

Open chfast opened this issue 2 years ago • 5 comments

The execution-spec-tests publish compiled JSON tests as a GitHub release at https://github.com/ethereum/execution-spec-tests/releases/latest.

  • [ ] Get the latest release and locally run the tests with evmone-statetest tool. Report any problems or failed tests.
  • [ ] Extend existing state-tests CI job to also download and run these tests. CI config: https://github.com/ethereum/evmone/blob/v0.10.0/circle.yml#L432-L449.

chfast avatar May 09 '23 19:05 chfast

@chfast Can you provide a little more context on this issue?

elijahhampton avatar May 10 '23 18:05 elijahhampton

@chfast Can you provide a little more context on this issue?

I've updated the description.

chfast avatar May 11 '23 11:05 chfast

Their JSON tests are only Blockchain tests I believe, and evmone-statetest runs only state tests?

gumb0 avatar May 16 '23 09:05 gumb0

Their JSON tests are only Blockchain tests I believe, and evmone-statetest runs only state tests?

True. On hold then.

chfast avatar May 16 '23 09:05 chfast

The test can be run via fill tool from execution-spec-tests.

fill --evm-bin evmone-t8n

chfast avatar Jul 22 '23 08:07 chfast