ThreadPools.jl
ThreadPools.jl copied to clipboard
Improved thread management for background and nonuniform tasks in Julia. Docs at https://tro3.github.io/ThreadPools.jl
When I run https://github.com/jonathan-laurent/AlphaZero.jl on Julia 1.7, It will run out of cpu and dont progress. Below is a minimal test(sometime it is ok, needs several times run). I think...
I tried using `qmap` for 70 work tasks with runtime between 1-100 min. Printing progress once after each task caused really bad performance. I believe `print` in all but thread...
I've run the following code to process a batch of files in external program: ```julia ThreadPools.@qthreads for i in 1:length(filelist) try file = filelist[i] run(`some external command on $file`) catch...
Looking at the code, it seems that `nthrds` is always capped at `Threads.nthreads()`. Is this restriction necessary? For example, I have some heavily IO bound tasks and I'd like to...
I'm not sure exactly what's going on here. I have a bit of code that works just fine with qmap, but throws a segfault when using tmap: ``` signal (11):...
I'm trying to use this library to parallelise a few I/O calls, Does it makes sense to use this library to work with I/O tasks in the following way ?...
Hi, thanks for this package! I had some downstream issues with Aqua and fixed the relevant parts in this package. I only left the ambiguities with deprecated functions in since...
Nice work! `qmap` efficiently solved the nonuniform-load task problems. Now I want to ask a deeper question. I have 2 nodes (or any HPC platforms) connecting to each other by...