django-q2
django-q2 copied to clipboard
A multiprocessing distributed task queue for Django based on Django-Q
Hi, I've setup a django-q2 cluster and I have a task that runs every 10 minutes. Usually it takes only 2-3 minutes to complete but in some circumnstances it could...
Maybe my understanding here is too weak and this isn't feasible, but I'd like to only mark some tasks to be non-daemonized. In short, I have tasks that kick off...
Hi, It seems that qcluster --run-once only runs queued tasks, but not those that have been scheduled to run since the last time the cluster ran. I need to run...
Looks like the monitor frequently executes the same command at the end of the task: https://github.com/django-q2/django-q2/blob/1b638e5802c7cb045d71e5b9b75aae74690c0e7e/django_q/monitor.py#L111 This query can take a very long time if the number of task entries...
From the docs it seems like it's not possible for a cluster to automatically discover tasks directly from code on server boot (e.g. django-dramatiq actors). It is either manually calling...
Reference to issue: [Original issue 394](https://github.com/Koed00/django-q/issues/394) I still have my 1 worker cluster stop processing tasks after a timeout / reincarnation. Hope you have the possibility to look into this...
This PR adds a broker that supports google cloud's pubsub message queue service. All that is required to use this new broker is setting the environment variables - `GOOGLE_CLOUD_PROJECT` -...
Hey, I am getting this error on one of my servers- ``` Message: BadSignature('Signature "Oi9T5QQeT9ag7ayHMWlnJ9ifcZ2vE1_TUNDgLnxAbK0" does not match') Arguments: ('Traceback (most recent call last):\n File "/home/ubuntu/dev-backend/venv/lib/python3.8/site-packages/django_q/cluster.py", line 356, in pusher\n...
Hello do you have any milestone to support redis sharding?
I'm working in my custom Django-Q monitoring solution. I have a setup with multiple clusters, spread around different queues: ```py Q_CLUSTER = { 'name': 'default_queue', # ... 'ALT_CLUSTERS': { 'SPECIALIZED_QUEUE_1':...