Two notebooks using DASK

[ivukotic]

When running two notebooks against the same dask instance, the first one to come to run processor will take over and the second one will simply hang until the first one is done.

[oshadura]

cc: @bbockelm

[bbockelm]

Makes sense. http://distributed.dask.org/en/latest/priority.html

If the user doesn't specify a priority, then tasks are executed in a FIFO. When the first processor starts, it'll generate all the tasks immediately.

We could do something like have the first 10 tasks boosted in priority so each processor has a few results quickly. We could also seriously refactor the processor code so there's fewer idle tasks at a time. However, it's never going to be a fair share.

Shouldn't this go to the Coffea project? I'm not sure there's much that Coffea-Casa can do here as this is just the implementation of the processor.