forget icon indicating copy to clipboard operation
forget copied to clipboard

Celery is a liability

Open codl opened this issue 4 years ago • 0 comments

Celery + beat continue to bite me in the butt whenever I stop looking at them, I don't think this "queue worker + queue scheduler pushing tasks at a steady rate" is healthy. Maybe it is time to change.

There are a couple of other queue systems in python but as far as I remember, they don't try to solve this particular problem.

Maybe a queue system is not the correct paradigm, as there are very few heavy jobs that are actually initiated by the user and need queueing:

  • A couple things that happen on log in
  • Twitter archives (haha rip)

Everything else just needs to happen on a schedule.

codl avatar Feb 07 '21 22:02 codl