docker icon indicating copy to clipboard operation
docker copied to clipboard

[BUG] can't run `python -m distributed.cli.dask_spec`

Open ntabris opened this issue 9 months ago • 3 comments

I'd like to be able to start Dask using python -m distributed.cli.dask_spec like so:

docker run rapidsai/base:24.04-cuda12.2-py3.9 python -m distributed.cli.dask_spec --spec [...]

But this gives me an error:

/opt/conda/bin/python: Error while finding module specification for 'distributed.cli.dask_spec.__main__' (ModuleNotFoundError: __path__ attribute not found on 'distributed.cli.dask_spec' while trying to find 'distributed.cli.dask_spec.__main__'); 'distributed.cli.dask_spec' is a package and cannot be directly executed

I don't understand what this means. Any idea why this isn't working? Can you make it work?

This seems to be something specific to the RAPIDS image, since this works fine with the normal dask container:

docker run daskdev/dask:latest python -m distributed.cli.dask_spec --spec '{"cls":"dask.distributed.Scheduler", "opts":{}}'

ntabris avatar May 06 '24 21:05 ntabris