aqa-test-tools icon indicating copy to clipboard operation
aqa-test-tools copied to clipboard

Improve $graphLookup query

Open llxia opened this issue 4 years ago • 0 comments

As TRSS stores more and more data, we noticed MongoError: $graphLookup reached maximum memory consumption

MongoError: $graphLookup reached maximum memory consumption
    at MessageStream.messageHandler (/home/testci/openjdk-test-tools/TestResultSummaryService/node_modules/mongodb/lib/cmap/connection.js:268:20)
    at MessageStream.emit (events.js:198:13)
    at processIncomingData (/home/testci/openjdk-test-tools/TestResultSummaryService/node_modules/mongodb/lib/cmap/message_stream.js:144:12)

According to the doc, The $graphLookup stage must stay within the 100 megabyte memory limit. We need to look into improve our $graphLookup query efficiency.

llxia avatar Mar 10 '21 19:03 llxia