Ned Batchelder

*Original comment by* **Abdeali Kothari (Bitbucket: [AbdealiJK](https://bitbucket.org/AbdealiJK), GitHub: [AbdealiJK](https://github.com/AbdealiJK))** ---------------------------------------- I read over http://coverage.readthedocs.io/en/latest/subprocess.html and tried: **EDIT**: Realized that setting the env variable to 1 was causing some issues as...

*Original comment by* **Abdeali Kothari (Bitbucket: [AbdealiJK](https://bitbucket.org/AbdealiJK), GitHub: [AbdealiJK](https://github.com/AbdealiJK))** ---------------------------------------- Ned, I am trying to see if I can understand what spark exactly does so we can figure this out....

Issue #657 is also about PySpark.

*Original comment by* **Abdeali Kothari (Bitbucket: [AbdealiJK](https://bitbucket.org/AbdealiJK), GitHub: [AbdealiJK](https://github.com/AbdealiJK))** ---------------------------------------- Hm, it may be a bit complicated to setup (spark can get messy to install) To reproduce, install: - Apache...

Thanks for the report. I've never used PySpark. Before I try to reproduce this, what packages do I need to install to be able to run this code? I'm on...

Do these help? - https://github.com/nvembar/spark-coverage-example - https://stackoverflow.com/a/67184714/14343

If someone could provide *very specific* step-by-step instructions to reproduce the failure, that would help move this forward (though no guarantees...)

@AndrewLane experimenting a bit with this, my guess is that the code is running in a subprocess, but that process is started in a way that doesn't get coverage started...

Here is what I have tried. I created a `doit.sh` file in my copy of the repo to configure subprocess measurement, and to simplify re-running it: ```bash cd /home rm...

Bytecode tracing is definitely an enabling technology, but there is still a lot to be done, including how to correlate tokens in the source with bytecodes at run-time. There's no...