arq
arq copied to clipboard
work distribution among workers
I have 500 jobs in my queue , worker as non-blocking function to wait for 5 sec. (asyncio.sleep(5)) , when I spawn 3 workers to do the jobs, I see one workers takes most of the work, and 2 other sits idle most of the time. How to make sure all 3 workers picks up job concurrently?
here are my worker configurations job_timeout = 100 keep_result = 0 poll_delay = 0.5 max_jobs = 50
Hello @sushmakoulgi
If you share your code, that would help a lot :)