celery-batches
celery-batches copied to clipboard
Celery Batches allows processing of multiple Celery task requests together
Hello! How can I use it with flower? "create_task" works fine with flower, but I can't see "count_click" tasks on flower. What could I do wrong? It feels like I'm...
Hi! I was looking at plugins for celery in the github and found celery-batches but didn't quite well get how it actually work. It'd be great to add **How does...
…ed requests - The above mentioned events will be useful to track the state of each request (which is a part of batched request list) in the monitoring tools like...
HI @clokep , thanks for the package. I'm interested to know a bit more about the `class SimpleRequest` . As mentioned in the doc string for `class SimpleRequest` (`SimpleRequest generally...
I'm trying to use celery-batches in chain, like this: ``` chain( task_foo.s(*args, **kwargs), batch_task.s(*args, **kwargs), task_bar.s(*args, **kwargs), ).apply_async() ``` Celery never registers `task_bar` as `batch_task` child and the chain cuts...
The celery batches doesn't do retries, in more detail it's described in https://github.com/celery/celery/issues/1498 with possible workaround.
Retrying tasks with countdowns can cause these tasks to pile up in the _pending queue. For argument's sake, let's say there are 10k such tasks (all with the same ETA)...
I open this issue to discuss / work on the `task-failed` events. For information, using events enables us (developpers) to monitor our celery batch apps using tools such as prometheus...
Following preceding works (not updated since), I do this PR to add the following modifications * Add signals.task_received to tests * Add events task-received, task-succeded and task-started * Format to...
Add "task-*" events so we can monitor the queue with Flower.