Guido Imperiale

Results 203 comments of Guido Imperiale
trafficstars

> > If it's inside the container things should be fine, no? > > Often `/tmp` is mounted in. Holy loss of segregation, Batman! Jokes aside, won't all the containers...

`/tmp/dask-worker-space-$UUID` then. Back to tmpfs vs. cwd: I'm very concerned about jupyter notebooks stored on NFS. Such notebooks will spill to NFS when they start a LocalCluster. I think that...

> With user namespacing the `UUID` will also be the same for all users so I'm afraid that doesn't help. I meant `uuid.uuid4()`, not `$UID`. Sorry for the confusion.

I believe #6241 is what you're looking for :) It's mosty done, it just misses unit tests and docs.

> IIUC, this issue is about even more than just memory sampling, isn't it? theoretically we could sample all kinds of metrics and plot them In theory, yes. In practice...

ts.previous == "flight". This is tightly related to #6705: The network stack raised, which caused `gather_dep` to return `GatherDepFailureEvent`, which is quite uncommon in real life and virtually untested.

Note that the scope of this issue is specifically about the state machine. The issue in the network stack is tracked separately, in #6875.

There are two failing tests. The amount of brain cells that died trying to understand them exhausted me, so I stopped work on this and I restarted from scratch on...

@fjetter I realised that `_transition_from_executing` is conceptually flawed. It assumes that we're getting there from one of the exit events of execute(), or in other words `assert ts.done`. Except that...

> Why is scattering even transitioning via executing? That sounds wrong. I remember concretely having a released->memory transition for this at some point in time There's nothing that stops a...