dramatiq
dramatiq copied to clipboard
Dramatiq workers hangs very often, no logs were seen in logs even if it is verbose mode.
Issues
GitHub issues are for bugs. If you have questions, please ask them on the mailing list.
Checklist
- [x] Does your title concisely summarize the problem?
- [x] Did you include a minimal, reproducible example?
- [x] What OS are you using?
- [x] What version of Dramatiq are you using?
- [x] What did you do?
- [x] What did you expect would happen?
- [x] What happened?
What OS are you using?
Centos
What version of Dramatiq are you using?
Dramatiq version 1.14.2
What did you do?
Processing parallel async requests using dramatiq
What did you expect would happen?
It should work properly it should receive messages and tasks, but it is getting hanged.
What happened?
We are processing parallel async requests. It will work fine for 3 days and again the same issue occurs. If we restart the workers then it works , how to fix this
dramatiq dramatiq_app.BatchOperationsDramatiqTasks --processes 1 --verbose
I cant see anything in logs files. Even logs getting hanged
error which i captured when logs got hanged
Exception in thread Thread-1: Traceback (most recent call last): File "/data/py3.9.7/lib/python3.9/[threading.py](https://threading.py/)", line 973, in _bootstrap_inner [self.run](https://self.run/)() File "/data/py3.9.7/lib/python3.9/[threading.py](https://threading.py/)", line 910, in run self._target(*self._args, **self._kwargs) File "/data/py3.9.7/Findly/lib/python3.9/site-packages/dramatiq/[cli.py](https://cli.py/)", line 328, in watch_logs data = event.recv_bytes() File "/data/py3.9.7/lib/python3.9/multiprocessing/[connection.py](https://connection.py/)", line 221, in recv_bytes buf = self._recv_bytes(maxlength) File "/data/py3.9.7/lib/python3.9/multiprocessing/[connection.py](https://connection.py/)", line 426, in _recv_bytes return self._recv(size) File "/data/py3.9.7/lib/python3.9/multiprocessing/[connection.py](https://connection.py/)", line 384, in _recv chunk = read(handle, remaining) MemoryError