django-rq icon indicating copy to clipboard operation
django-rq copied to clipboard

Dynamic queues

Open and-sm opened this issue 5 years ago • 1 comments

My Django background tasks must be performed by separated workers, each with own queue. Queues count isn't fixed (random clients count, each produce fixed request execution order etc.) I tried run rq workers with subprocess from django views, but unfortunatelly got https://github.com/rq/rq/issues/1180.

Now I'm trying to use manage.py rqworker, but unfortunatelly it can use only static list of queues from settings.py. Is it even possible to use custom names and non fixed queues count using django-rq?

For example: Queue(name=uuid, connection=self.redis, is_async=True) manage.py rqworker uuid

and-sm avatar Jan 19 '20 19:01 and-sm

If you can fall back to plain RQ, you don't need to pre-specify the queue names.

https://python-rq.org/docs/#on-the-design If we find an answer it'd be great to also update https://stackoverflow.com/questions/56424823/auto-creating-queues-in-djangorq

JethroMV avatar Mar 10 '20 14:03 JethroMV