Alexey Zaytsev
Alexey Zaytsev
I'm not super familiar with parallel programming, especially in Python, so here's a simple solution that I can think of. A partial function `f` is passed to `parallel()`, and it...
So this was a bit of a rabbit hole. I introduced `class ThreadPool(multiprocessing.pool.Pool)` that more or less mirrors Fastcore `ThreadPoolExecutor`. Problem is, `pool.Pool` creates daemon processes, and those can't have...
@jph00 , I think the SO reply refers to `concurrent.futures.ProcessPoolExecutor`, which does not support max tasks per child. Please have a look at https://github.com/fastai/fastcore/pull/515 and #1296
I'm getting the same thing. To reproduce more easily, I set the token to 10 seconds. I'm running with supabase/ssr server-only with SvelteKit, a single supabase client in locals that...
Ok, I think I know what's going on, at least in my case. There is a race condition between the check for the session expiration and when the session is...
Will do, thank you.
Ok, `parallel` is getting out of hand, now with half a dozen interconnected parameters that all affect its behaviour in significant and non-straight-forward ways: - `n_workers` - Has a side-effect...
@jph00 , I had a crack at it. What do you think? https://github.com/xl0/fastcore/blob/minpool/nbs/03a_parallel.ipynb All fastai tests worked with --n_workers=1 and default.
@jph00 , Thank you for the clarification. No, I did test with fastcore, nbdev and fastai. I just checked - execnb passes clearly, ghapi needs to drop `threadpool=True` in nb...