DIRAC icon indicating copy to clipboard operation
DIRAC copied to clipboard

Crazy CPU consumption on blocked Thread

Open chaen opened this issue 2 years ago • 0 comments

I've observed the CS going banana because it was stuck in an infinite loop

The problem in the stack trace below is packSentBytes: -70265710922 which is supposed to be positive From a very quick look, the problem would seem to come from the process unable to allocate memory in M2Crypto. Low priority....

    sendData (DIRAC/Core/DISET/private/Transports/BaseTransport.py:173)
        Arguments:
            self: <SSLTransport at 0x7f724c1af690>
            uData: {"OK": False, "Errno": 0, "Message": "Invalid action proposal", "CallStack": ["  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1002, in _bootstrap\n    self._bootstrap_i
nner()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1045, in _bootstrap_inner\n    self.run()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/thre
ading.py\", line 982, in run\n    self._target(*self._args, **self._kwargs)\n", ...]}
            prefix: <bytes at 0x561461fe6bc8>
        Locals:
            sCodedData: <bytes at 0x7f723c02a170>
            dataToSend: <bytes at 0x7f723c02c0b0>
            index: 0
            bytesToSend: 1283
            packSentBytes: -70265710922
            result: {"OK": True, "Value": -1}
            sentBytes: -1
    sendAndClose (DIRAC/Core/DISET/private/TransportPool.py:125)
        Arguments:
            self: <TransportPool at 0x7f7251ee5210>
            trid: "2001:1458:d00:12::145:9135->2001:1458:301:52::100:79:35924"
            msg: {"OK": False, "Errno": 0, "Message": "Invalid action proposal", "CallStack": ["  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1002, in _bootstrap\n    self._bootstrap_inner()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1045, in _bootstrap_inner\n    self.run()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 982, in run\n    self._target(*self._args, **self._kwargs)\n", ...]}
    _processInThread (DIRAC/Core/DISET/private/Service.py:339)
        Arguments:
            self: <Service at 0x7f725165ef90>
            clientTransport: <SSLTransport at 0x7f724c1af690>
        Locals:
            monReport: (1707262143.3921127, 3041.25, 121.546875)
            result: {"OK": False, "Errno": 0, "Message": "Invalid action proposal", "CallStack": ["  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1002, in _bootstrap\n    self._bootstrap_inner()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 1045, in _bootstrap_inner\n    self.run()\n", "  File \"/opt/dirac/versions/v11.0.31-1707226432/Linux-x86_64/lib/python3.11/threading.py\", line 982, in run\n    self._target(*self._args, **self._kwargs)\n", ...]}
            trid: "2001:1458:d00:12::145:9135->2001:1458:301:52::100:79:35924"

chaen avatar Feb 09 '24 15:02 chaen