action icon indicating copy to clipboard operation
action copied to clipboard

Documentation/advice on differences of direct vs codspeed runner test execution

Open mih opened this issue 1 year ago • 2 comments

In https://github.com/datalad/datalad-next/pull/644 I have added benchmarks and a codspeed Github action. Benchmarks run fine locally and in the action via python -m pytest --codspeed datalad_next (see "Debug" step).

However, when executed within CodSpeedHQ/action@v2 the execution fails, because a required command is not found. This is independent of whether that command is installed via the method in the PR, or as an Ubuntu system package.

Can you advice on what to do in this case? Are there additional requirements to be met for compatibility with the codspeed runner?

Thanks in advance!

mih avatar Feb 20 '24 13:02 mih