Itamar Turner-Trauring

It would be useful for some users to be able to get the source distribution from PyPI, not just compiled binaries. ### Discussed in https://github.com/pythonspeed/filprofiler/discussions/329 Originally posted by **Stonre** March...

So it doesn't get imported by accident...

E.g. imbl (maintained) or rpds (simpler) since im is no longer maintained.

Track memory from subprocesses

6

`multiprocessing` and other similar systems are basically the same program, just with multiple processes. That memory should be tracked together. Implementation ideas: 1. Each subprocess tracks its own info. 2....

Basically like Jupyter, but need to start IPython in a special way (`filprofile python -m IPython` or something like that?).

Figure out how to use Fil with Metaflow

1

`@conda` decorator might be good starting point?

No one cares where NumPy is installed, probably, they care that NumPy was the one that allocated memory. So let's make the formatting a little less verbose.

Insofar as Fil4prod uses this, reducing potential panics is important.

Document usage with Airflow

1

Document how to use Fil with Airflow tasks. @timur-orudzhov could you explain a little bit how you run Airflow, and what kind of executors you use? Did you expect to...

Document usage with Celery workers

2

Specifically, tracking memory usage on a task level.