maelstrom icon indicating copy to clipboard operation
maelstrom copied to clipboard

Use the same environment for both pytest collect/run phases

Open zed opened this issue 5 months ago • 3 comments

Specific Maelstrom Program? maelstrom-pytest

Problem Statement Current behavior: maelstorm-pytest runs pytest in the local environment to collect tests, then tests are run inside containers e.g., created using test-requirements.txt It may create subtle differences and corresponding bugs.

Proposed Solution

Run both collect/run test phases in the environments created the same way (both run inside containers).

Additional Context

It is also more convenient to replace (current behavior):

git checkout "$TEST_BRANCH"  # get source
uv venv .venv
source .venv/bin/activate
uv pip install -r test-requirements.txt
maelstrom-pytest  # run unit tests

with

git checkout "$TEST_BRANCH"  # get source
maelstrom-pytest  # run unit tests

zed avatar Aug 29 '24 10:08 zed