cmdstalk
cmdstalk copied to clipboard
99designs
beanstalkd broker; run jobs as unix commands.
Use case: I have 100k items I'd like to process when my system is under low load. By submitting 100 `batch`[1] jobs doing cmdstalk -cmd=my-script.sh -max-jobs 1000 I know processing...
...on interrupt signal. Fixes a TODO. Also a prerequisite for a pull request that adds an upper limit to the number of jobs processed. See separate pull request for that.
I tried to change as little as possible in the existing code to make this work...
In handover we have some tasks that have various failure scenarios; sometimes it would be most appropriate to bury a task, other times it could be re-queued, maybe with a...
When a job overruns it's TTR, beanstalkd will increment the job's timeout stat and put it back on the work queue for another worker to reserve. In an effort to...
One drawback to our current docker setup is that services like mysql and beanstalk are not isolated between 99designs services (contests / swiftly etc). This issue doesn't manifest for mysql,...