Tibor Arpas

Can you test the difference in performance between reference run with and without testmon? Anders, I'll probably not have time to take a look at this in the coming months,...

No, testmon wouldn't be able to recognize `file.json` as a dependency of the code. AFAIK coverage is and will always deal with executable files and lines but not I/O. https://coverage.readthedocs.io/en/6.0.2/api_plugin.html#file-tracers...

See one of the use cases: https://github.com/tarpas/pytest-testmon/issues/49

Correct. Users are welcome to react or comment to this issue so that I know how important it is.

Hi. I prioritized other things because testmon doesn't support pytest --pyargs and also because I'm not able to run the test suite on my M1 Macbook (tensorflow started crashing under...

Per this: _by @lmmentel in https://github.com/alan-turing-institute/sktime/issues/2389#issuecomment-1087828335_ sktime started using --pyargs because pytest was picking up some files (associated with cython which you don't use anymore anyway) which it shouldn't have...

@fkiraly can you point me to a PR where there is suspicion testmon might not pick up changes correctly? Would that be adding a new estimator class? Can you point...

I think both profiling the test collection and splitting the whole test suite are quite important steps. Both would be very helpful. The 10 minutes collection time makes any experiments...

I hope it's not too impolite to point out 2 projects which already implement this: https://github.com/ChrisBeaumont/smother http://github.com/tarpas/pytest-testmon

> also wanted to know how to handle scenario, when i have no changes and its a scheduled test i used flag `--testmon-noselect` so it does run all tests but...