docker
docker copied to clipboard
[BUG] can't run `python -m distributed.cli.dask_spec`
I'd like to be able to start Dask using python -m distributed.cli.dask_spec
like so:
docker run rapidsai/base:24.04-cuda12.2-py3.9 python -m distributed.cli.dask_spec --spec [...]
But this gives me an error:
/opt/conda/bin/python: Error while finding module specification for 'distributed.cli.dask_spec.__main__' (ModuleNotFoundError: __path__ attribute not found on 'distributed.cli.dask_spec' while trying to find 'distributed.cli.dask_spec.__main__'); 'distributed.cli.dask_spec' is a package and cannot be directly executed
I don't understand what this means. Any idea why this isn't working? Can you make it work?
This seems to be something specific to the RAPIDS image, since this works fine with the normal dask container:
docker run daskdev/dask:latest python -m distributed.cli.dask_spec --spec '{"cls":"dask.distributed.Scheduler", "opts":{}}'