DIRAC icon indicating copy to clipboard operation
DIRAC copied to clipboard

Stompy errors in matcher

Open chrisburr opened this issue 9 months ago • 3 comments

2025-02-22 04:46:24 UTC WorkloadManagement/Matcher WARN: Sleeping as service requested throttling WorkloadManagement/Matcher
error sending frame
Traceback (most recent call last):
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Resources/MessageQueue/StompMQConnector.py", line 177, in put
    self.connection.send(body=json.dumps(message), destination=destination)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/protocol.py", line 402, in send
    self.send_frame(CMD_SEND, headers, body)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/protocol.py", line 246, in send_frame
    self.transport.transmit(frame)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/transport.py", line 269, in transmit
    self.send(packed_frame)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/transport.py", line 629, in send
    raise exception.NotConnectedException()
stomp.exception.NotConnectedException

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Resources/MessageQueue/StompMQConnector.py", line 206, in connect
    self.connection.connect(username=user, passcode=password, wait=True)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/connect.py", line 151, in connect
    Protocol11.connect(self, *args, **kwargs)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/protocol.py", line 336, in connect
    self.send_frame(cmd, headers)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/protocol.py", line 246, in send_frame
    self.transport.transmit(frame)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/transport.py", line 269, in transmit
    self.send(packed_frame)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/transport.py", line 629, in send
    raise exception.NotConnectedException()
stomp.exception.NotConnectedException

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/DIRAC/Resources/MessageQueue/StompMQConnector.py", line 177, in put
    self.connection.send(body=json.dumps(message), destination=destination)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/protocol.py", line 402, in send
    self.send_frame(CMD_SEND, headers, body)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/protocol.py", line 246, in send_frame
    self.transport.transmit(frame)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/transport.py", line 269, in transmit
    self.send(packed_frame)
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/transport.py", line 629, in send
    raise exception.NotConnectedException()
stomp.exception.NotConnectedException

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/transport.py", line 623, in send
    self.socket.sendall(encoded_frame)
OSError: [Errno 9] Bad file descriptor
error sending frame
Traceback (most recent call last):
  File "/opt/dirac/versions/v11.0.58-1739363684/Linux-x86_64/lib/python3.11/site-packages/stomp/transport.py", line 623, in send
    self.socket.sendall(encoded_frame)
    ^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'sendall'

chrisburr avatar Feb 22 '25 04:02 chrisburr

Hum, I was convinced I had fixed it with https://github.com/DIRACGrid/DIRAC/pull/8025/commits/f11a014a7df81b3985809bc254d3e2f9c146eda4 :-(

chaen avatar Feb 24 '25 20:02 chaen

My proposed solution is: https://github.com/DIRACGrid/DIRAC/pull/8057

chrisburr avatar Feb 28 '25 12:02 chrisburr

I fail to see how that fixes it ?

chaen avatar Feb 28 '25 12:02 chaen