waha icon indicating copy to clipboard operation
waha copied to clipboard

[NOWEB] - Connection hangup and much more

Open whoami-netizen opened this issue 2 months ago • 13 comments

Describe the bug

Ever since upgrading from version 2025.9.5 to 2025.9.8, the system has become extremely unstable. I manage 22 instances of WAHA, and after upgrading around 15 of them, multiple severe issues appeared:

Containers failed to start due to a lock issue on the SQLite folder. This led to the loss of around 2000 active sessions when migrating to PostgreSQL.

Sessions on PostgreSQL and those that survived the upgrade are extremely unstable — API requests time out, containers hang, and connections drop randomly.

Messages are being duplicated — a single API call sends multiple copies of the same message.

Poll.vote webhooks fail intermittently.

Frequent disconnects observed even in version 2025.9.5, but 2025.9.8 made it much worse.

This has caused significant service disruptions and financial losses due to serverless timeouts and retries.

Version

{
  "version": "2025.9.8",
  "engine": "NOWEB",
  "tier": "PLUS"
}

Downgrading back to 2025.9.5 resolves most of these issues, so it’s clearly a regression introduced in 2025.9.8.

Additional Context

Using NOWEB engine (cannot migrate to GOWS due to existing infrastructure and session data).

These problems do not occur in 2025.9.5.

Downgrading immediately restores stability.

Would appreciate if you could confirm whether these upstream issues were reverted or fixed in newer releases.

Docker logs:

2025-10-06T17:40:54.649433829Z [17:40:54.582] WARN (NOWEBEngine/7): session:65501626534 - timed out waiting for message {"session":"65501626534","msgId":"22314.47162-16"}
2025-10-06T17:40:54.649778990Z [17:40:54.583] INFO (NOWEBEngine/7): session:65501626534 - recreating session for retry {"session":"65501626534","fromJid":"status@broadcast","retryCount":1,"reason":"we don't have a Signal session with them"}
2025-10-06T17:40:54.649811470Z [17:40:54.597] INFO (NOWEBEngine/7): session:65501626534 - sent retry receipt {"session":"65501626534","msgAttrs":{"from":"status@broadcast","type":"media","id":"3A28A4A0F6322915743B","participant":"[[email protected]](mailto:[email protected])","offline":"1","participant_lid":"66808249897167@lid","notify":"Jaimin","t":"1759771673"},"retryCount":1}
2025-10-06T17:40:56.704444102Z [17:40:55.965] INFO (NOWEBEngine/7): session:68066312350 - resyncing regular_low from v0 {"session":"68066312350"}
2025-10-06T17:40:56.704549182Z [17:40:55.991] INFO (NOWEBEngine/7): session:69724078326 - connected to WA {"session":"69724078326","browser":["Ubuntu","Chrome","20.0.04"],"helloMsg":{"clientHello":{"ephemeral":"QnirX0iNXG2aSq131M7gXn7DyTdbL54WhVGy6R6SYEM="}}}
2025-10-06T17:40:56.704591822Z [17:40:56.131] INFO (NOWEBEngine/7): session:69724078326 - logging in... {"session":"69724078326","node":{"username":"923002894735","passive":false,"userAgent":{"platform":"WEB","appVersion":{"primary":2,"secondary":3000,"tertiary":1023223821},"mcc":"000","mnc":"000","osVersion":"0.1","device":"Desktop","osBuildNumber":"0.1","releaseChannel":"RELEASE","localeLanguageIso6391":"en","localeCountryIso31661Alpha2":"US"},"webInfo":{"webSubPlatform":"WEB_BROWSER"},"connectType":"WIFI_UNKNOWN","connectReason":"USER_ACTIVATED","device":4,"pull":true}}
2025-10-06T17:40:57.221195492Z [17:40:57.000] INFO (regular_low/7): session:68066312350 - failed to sync state from version, removing and trying from scratch {"session":"68066312350"}
2025-10-06T17:40:57.221302012Z     error: "Error: error:1C800064:Provider routines::bad decrypt\n    at Decipheriv.final (node:internal/crypto/cipher:184:29)\n    at aesDecryptWithIV (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/crypto.js:77:51)\n    at aesDecrypt (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/crypto.js:72:12)\n    at decodeSyncdMutations (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/chat-utils.js:157:24)\n    at async decodeSyncdSnapshot (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/chat-utils.js:257:37)\n    at async file:///app/node_modules/@adiwajshing/baileys/lib/Socket/chats.js:408:70\n    at async file:///app/node_modules/@adiwajshing/baileys/lib/Utils/auth-utils.js:222:36"
2025-10-06T17:40:57.221318292Z [17:40:57.000] INFO (NOWEBEngine/7): session:68066312350 - resyncing regular_low from v0 {"session":"68066312350"}
2025-10-06T17:40:57.340901872Z [17:40:57.097] INFO (7): request completed {"reqId":275,"req":{"id":275,"method":"POST","url":"/api/stopTyping","query":{},"params":{"path":["api","stopTyping"]}},"res":{"statusCode":201},"responseTime":11}
2025-10-06T17:40:57.603577371Z [17:40:57.595] INFO (7): request completed {"reqId":277,"req":{"id":277,"method":"POST","url":"/api/startTyping","query":{},"params":{"path":["api","startTyping"]}},"res":{"statusCode":201},"responseTime":9}
2025-10-06T17:40:57.735880642Z [17:40:57.480] INFO (regular_low/7): session:68066312350 - failed to sync state from version, removing and trying from scratch {"session":"68066312350"}
2025-10-06T17:40:57.735944242Z     error: "Error: error:1C800064:Provider routines::bad decrypt\n    at Decipheriv.final (node:internal/crypto/cipher:184:29)\n    at aesDecryptWithIV (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/crypto.js:77:51)\n    at aesDecrypt (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/crypto.js:72:12)\n    at decodeSyncdMutations (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/chat-utils.js:157:24)\n    at async decodeSyncdSnapshot (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/chat-utils.js:257:37)\n    at async file:///app/node_modules/@adiwajshing/baileys/lib/Socket/chats.js:408:70\n    at async file:///app/node_modules/@adiwajshing/baileys/lib/Utils/auth-utils.js:222:36"
2025-10-06T17:40:57.737322643Z [17:40:57.483] INFO (NOWEBEngine/7): session:68066312350 - resyncing regular_low from v0 {"session":"68066312350"}
2025-10-06T17:40:57.737379443Z [17:40:57.511] WARN (NowebPersistentStore/7): session:91219329328 - got update for non-existent message. update: '{"key":{"remoteJid":"59228337258584@lid","id":"A5784C448E275E7DE61885F84DB0A299","fromMe":true},"update":{"status":4}}' {"session":"91219329328"}
2025-10-06T17:40:57.737413243Z [17:40:57.653] WARN (NOWEBEngine/7): session:55976460355 - timed out waiting for message {"session":"55976460355","msgId":"47683.46997-16"}
2025-10-06T17:40:57.737417883Z [17:40:57.654] INFO (NOWEBEngine/7): session:55976460355 - recreating session for retry {"session":"55976460355","fromJid":"[[email protected]](mailto:[email protected])","retryCount":1,"reason":"we don't have a Signal session with them"}
2025-10-06T17:40:57.737422163Z [17:40:57.671] INFO (NOWEBEngine/7): session:55976460355 - sent retry receipt {"session":"55976460355","msgAttrs":{"from":"[[email protected]](mailto:[email protected])","type":"media","id":"A5BCBA355DC1BCE10B9A3C4143AF9259","participant":"170256949592251@lid","offline":"1","participant_pn":"[[email protected]](mailto:[email protected])","verified_level":"low","notify":"Mrs Tayyab","addressing_mode":"lid","expiration":"86400","verified_name":"4587379092826069178","t":"1759745934"},"retryCount":1}
2025-10-06T17:40:57.997744940Z [17:40:57.931] INFO (regular_low/7): session:68066312350 - failed to sync state from version {"session":"68066312350"}
2025-10-06T17:40:57.997795700Z     error: "Error: error:1C800064:Provider routines::bad decrypt\n    at Decipheriv.final (node:internal/crypto/cipher:184:29)\n    at aesDecryptWithIV (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/crypto.js:77:51)\n    at aesDecrypt (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/crypto.js:72:12)\n    at decodeSyncdMutations (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/chat-utils.js:157:24)\n    at async decodeSyncdSnapshot (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/chat-utils.js:257:37)\n    at async file:///app/node_modules/@adiwajshing/baileys/lib/Socket/chats.js:408:70\n    at async file:///app/node_modules/@adiwajshing/baileys/lib/Utils/auth-utils.js:222:36"
2025-10-06T17:40:58.118105000Z [17:40:57.993] INFO (7): request completed {"reqId":276,"req":{"id":276,"method":"POST","url":"/api/sendText","query":{},"params":{"path":["api","sendText"]}},"res":{"statusCode":201},"responseTime":873}
2025-10-06T17:40:58.511234568Z [17:40:58.253] INFO (NOWEBEngine/7): session:69724078326 - connection errored {"session":"69724078326","trace":"Error: Connection Failure\n    at WebSocketClient.<anonymous> (file:///app/node_modules/@adiwajshing/baileys/lib/Socket/socket.js:742:13)\n    at WebSocketClient.emit (node:events:518:28)\n    at file:///app/node_modules/@adiwajshing/baileys/lib/Socket/socket.js:426:35\n    at Object.decodeFrame (file:///app/node_modules/@adiwajshing/baileys/lib/Utils/noise-handler.js:140:17)\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)"}
2025-10-06T17:40:58.511630609Z [17:40:58.254] INFO (WhatsappSession/7): session:69724078326 - Connection closed due to 'Error: Connection Failure', reconnecting... {"session":"69724078326"}
2025-10-06T17:40:58.511661809Z [17:40:58.255] INFO (WhatsappSession/7): session:69724078326 - Job scheduled with timeout 2000 ms {"session":"69724078326","job":"start-engine","class":"SingleDelayedJobRunner"}
2025-10-06T17:40:58.575254182Z [17:40:58.543] WARN (NOWEBEngine/7): session:69724078326 - Buffer timeout reached, auto-flushing {"session":"69724078326"}
2025-10-06T17:40:58.836421000Z [17:40:58.727] WARN (NowebPersistentStore/7): session:70404047023 - got update for non-existent contact. update: '{"id":"[[email protected]](mailto:[email protected])","notify":"KOÌ Ni"}' {"session":"70404047023"}
2025-10-06T17:40:59.099404899Z [17:40:59.034] WARN (NowebPersistentStore/7): session:70195020031 - failed to get profile picture for contact '[[email protected]](mailto:[email protected])': Error: item-not-found {"session":"70195020031"}
2025-10-06T17:40:59.099659859Z [17:40:59.074] ERROR (NOWEBEngine/7): session:70396084472 - transaction failed, rolling back {"session":"70396084472"}
2025-10-06T17:40:59.099682739Z     error: {}
2025-10-06T17:40:59.099686619Z [17:40:59.075] ERROR (NOWEBEngine/7): session:70396084472 - failed to decrypt message {"session":"70396084472","key":{"remoteJid":"status@broadcast","remoteJidAlt":"188884071764222@lid","fromMe":false,"id":"ACECE1996C582813068B24A25E0B9DE4","participant":"[[email protected]](mailto:[email protected])","addressingMode":"pn"},"messageType":"skmsg","sender":"status@broadcast","author":"[[email protected]](mailto:[email protected])","isSessionRecordError":false}
2025-10-06T17:40:59.099692299Z     err: {
2025-10-06T17:40:59.099694779Z       "type": "Error",
2025-10-06T17:40:59.099697539Z       "message": "Invalid public key",
2025-10-06T17:40:59.099700539Z       "stack":
2025-10-06T17:40:59.099703259Z           Error: Invalid public key
2025-10-06T17:40:59.099705779Z               at scrubPubKeyFormat (/app/node_modules/libsignal/src/curve.js:38:15)
2025-10-06T17:40:59.099708539Z               at exports.verifySignature (/app/node_modules/libsignal/src/curve.js:112:14)
2025-10-06T17:40:59.099711299Z               at SenderKeyMessage.verifySignature (file:///app/node_modules/@adiwajshing/baileys/lib/Signal/Group/sender-key-message.js:49:21)
2025-10-06T17:40:59.099714339Z               at GroupCipher.decrypt (file:///app/node_modules/@adiwajshing/baileys/lib/Signal/Group/group_cipher.js:37:26)
2025-10-06T17:40:59.099717139Z               at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
2025-10-06T17:40:59.099719979Z               at async file:///app/node_modules/@adiwajshing/baileys/lib/Utils/auth-utils.js:222:36
2025-10-06T17:40:59.099722699Z     }
2025-10-06T17:41:01.150304532Z [17:41:00.812] INFO (NOWEBEngine/7): session:69724078326 - connected to WA {"session":"69724078326","browser":["Ubuntu","Chrome","20.0.04"],"helloMsg":{"clientHello":{"ephemeral":"V6oznGiTannnywBjWlji3vcTxXNg7BS3E2X3sHTXuBI="}}}
2025-10-06T17:41:01.151766333Z [17:41:01.099] INFO (NOWEBEngine/7): session:69724078326 - logging in... {"session":"69724078326","node":{"username":"923002894735","passive":false,"userAgent":{"platform":"WEB","appVersion":{"primary":2,"secondary":3000,"tertiary":1023223821},"mcc":"000","mnc":"000","osVersion":"0.1","device":"Desktop","osBuildNumber":"0.1","releaseChannel":"RELEASE","localeLanguageIso6391":"en","localeCountryIso31661Alpha2":"US"},"webInfo":{"webSubPlatform":"WEB_BROWSER"},"connectType":"WIFI_UNKNOWN","connectReason":"USER_ACTIVATED","device":4,"pull":true}}

patron:PLUS

whoami-netizen avatar Oct 15 '25 07:10 whoami-netizen