crowd.dev icon indicating copy to clipboard operation
crowd.dev copied to clipboard

We keep getting timeout errors in streamActivities method because of QuestDB

Open joanagmaia opened this issue 7 months ago • 0 comments

{"name":"entity-merging-worker","pid":34,"component":"questdb.sql.connection","level":"ERROR","err":{"message":"timeout, query aborted","name":"error","stack":"error: timeout, query aborted\n    at Parser.parseErrorMessage (/usr/crowd/app/node_modules/.pnpm/[email protected]/node_modules/pg-protocol/src/parser.ts:369:69)\n    at Parser.handlePacket (/usr/crowd/app/node_modules/.pnpm/[email protected]/node_modules/pg-protocol/src/parser.ts:188:21)\n    at Parser.parse (/usr/crowd/app/node_modules/.pnpm/[email protected]/node_modules/pg-protocol/src/parser.ts:103:30)\n    at TLSSocket.<anonymous> (/usr/crowd/app/node_modules/.pnpm/[email protected]/node_modules/pg-protocol/src/index.ts:7:48)\n    at TLSSocket.emit (node:events:524:28)\n    at TLSSocket.emit (node:domain:489:12)\n    at addChunk (node:internal/streams/readable:561:12)\n    at readableAddChunkPushByteMode (node:internal/streams/readable:512:3)\n    at Readable.push (node:internal/streams/readable:392:5)\n    at TLSWrap.onStreamRead (node:internal/stream_base_commons:191:23)","code":"00000"},"msg":"{\n  query: `SELECT * FROM activities WHERE \"memberId\" = '7c69ce20-5879-11ee-9b4e-eb428b27ceb8'`,\n  params: null\n} Error executing a QuestDB query!","time":"2025-03-17T14:11:38.664Z","v":0}

The query done by pg-query-stream seems to time out.
This is currently the main reason for workflows to fail in temporal for merge and unmerge operation -> It never completes and just retries hundreds of times

joanagmaia avatar Mar 18 '25 14:03 joanagmaia