In Aleph, tasks seem to be stuck and no progress is made

[brassy-endomorph]

For whatever reason (logs output nothing helpful), some tasks seem to be failing and this blocks all other tasks. We have millions of enqueued tasks, and tasks continuously start and fail causing the containers to crash.

It would be helpful if failed tasks were moved to the back of the queue so things would progress at all until only failing tasks remain.