wikiloop-doublecheck icon indicating copy to clipboard operation
wikiloop-doublecheck copied to clipboard

Published 20 hours ago • verified publisher icon google

Bug: seemingly out of memory after push of commit

Open xinbenlv opened this issue 3 years ago • 0 comments

Seemingly out of memory after push of commit 0b2c84337bae560e948f3fd3aba1f2858fb39025

2021-09-04T16:23:34.456966+00:00 app[web.1]: nuxtServerInit req.session.id k5kchkOVnP8yxG6Wy1maszDS94zIva7V
2021-09-04T16:23:34.456987+00:00 app[web.1]: nuxtServerInit done
2021-09-04T16:23:34.553513+00:00 heroku[router]: at=info method=GET path="/" host=doublecheck.wikiloop.org request_id=c3f641aa-7ba8-4d8f-9339-9e7b93eeee00 fwd="63.143.42.245" dyno=web.1 connect=0ms service=449ms status=200 bytes=70207 protocol=http
2021-09-04T16:23:34.555929+00:00 app[web.1]: ga_id= session_id=k5kchkOVnP8yxG6Wy1maszDS94zIva7V level=info message="PERF       446ms  200 GET /"
2021-09-04T16:23:49.580034+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00
2021-09-04T16:23:49.680110+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=302.19MB sample#memory_rss=302.19MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=111589pages sample#memory_pgpgout=40360pages sample#memory_quota=512.00MB
2021-09-04T16:24:16.004133+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00
2021-09-04T16:24:16.077716+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=302.39MB sample#memory_rss=302.39MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=114397pages sample#memory_pgpgout=43116pages sample#memory_quota=512.00MB
2021-09-04T16:24:43.228293+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00
2021-09-04T16:24:43.305094+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=302.69MB sample#memory_rss=302.68MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=117484pages sample#memory_pgpgout=46128pages sample#memory_quota=512.00MB
2021-09-04T16:25:09.071559+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00
2021-09-04T16:25:09.188739+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=302.80MB sample#memory_rss=302.80MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=120286pages sample#memory_pgpgout=48900pages sample#memory_quota=512.00MB
2021-09-04T16:25:16.207268+00:00 app[web.1]: ga_id= session_id=geeRPHLjwflNYaJ-Sb_2xwRLJZkJ4to6 level=info message="PERF        15ms  200 GET /api/flags"
2021-09-04T16:25:16.233392+00:00 app[web.1]: ga_id= session_id=jhslXZWy6ZtT0Dd29tAf3lPN1EXVvKcl level=info message="PERF        24ms  200 GET /api/version"
2021-09-04T16:25:16.370335+00:00 app[web.1]: ga_id= session_id=6U3sX3FRHDlyR6gyxbLcBe5cla0A8e7w level=info message="PERF       135ms  200 GET /api/metrics"
2021-09-04T16:25:16.370526+00:00 app[web.1]: nuxtServerInit store state clearProfile because req.user is not defined
2021-09-04T16:25:16.370576+00:00 app[web.1]: nuxtServerInit req.session.id yhPJ6mVK6Jsj3H9OKCd9sHn987BPn_oe
2021-09-04T16:25:16.370592+00:00 app[web.1]: nuxtServerInit done
2021-09-04T16:25:16.446428+00:00 app[web.1]: ga_id= session_id=yhPJ6mVK6Jsj3H9OKCd9sHn987BPn_oe level=info message="PERF       271ms  200 GET /empty"
2021-09-04T16:25:16.446896+00:00 heroku[router]: at=info method=GET path="/empty" host=doublecheck.wikiloop.org request_id=6f88f949-6fbb-4eba-b53c-40f94ae04f89 fwd="216.245.221.88" dyno=web.1 connect=0ms service=272ms status=200 bytes=70182 protocol=http
2021-09-04T16:25:35.207440+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00
2021-09-04T16:25:35.271235+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=300.58MB sample#memory_rss=300.57MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=124313pages sample#memory_pgpgout=53497pages sample#memory_quota=512.00MB
2021-09-04T16:25:41.358046+00:00 app[web.1]: ga_id= session_id=E3RUVcuwSm1VnrcONx0J70gpbnjB1o6A level=info message="PERF        16ms  200 GET /api/flags"
2021-09-04T16:25:41.371366+00:00 app[web.1]: ga_id= session_id=grlZ5BKmZ75USZ3FNN6-3dBbrO9ZEFd2 level=info message="PERF        11ms  200 GET /api/version"
2021-09-04T16:25:41.464554+00:00 app[web.1]: ga_id= session_id=LOBlFKDD7oDtrPHp69LwgZIj_4J_hG9Y level=info message="PERF        91ms  200 GET /api/metrics"
2021-09-04T16:25:41.464807+00:00 app[web.1]: nuxtServerInit store state clearProfile because req.user is not defined
2021-09-04T16:25:41.464873+00:00 app[web.1]: nuxtServerInit req.session.id M54Leym5NsDW3a7MVylypPWxOC3m6N9Q
2021-09-04T16:25:41.464896+00:00 app[web.1]: nuxtServerInit done
2021-09-04T16:25:41.563069+00:00 heroku[router]: at=info method=GET path="/" host=doublecheck.wikiloop.org request_id=069fee03-5e8f-4b02-aa5f-256c9ecf1527 fwd="63.143.42.245" dyno=web.1 connect=0ms service=249ms status=200 bytes=70207 protocol=http
2021-09-04T16:25:41.564153+00:00 app[web.1]: ga_id= session_id=M54Leym5NsDW3a7MVylypPWxOC3m6N9Q level=info message="PERF       248ms  200 GET /"
2021-09-04T16:26:06.865553+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00
2021-09-04T16:26:06.901889+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=302.84MB sample#memory_rss=302.83MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=128171pages sample#memory_pgpgout=56777pages sample#memory_quota=512.00MB
2021-09-04T16:26:33.692014+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00
2021-09-04T16:26:33.747127+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=303.50MB sample#memory_rss=303.50MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=131348pages sample#memory_pgpgout=59784pages sample#memory_quota=512.00MB
2021-09-04T16:26:59.200748+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00
2021-09-04T16:26:59.236455+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=303.52MB sample#memory_rss=303.52MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=134369pages sample#memory_pgpgout=62800pages sample#memory_quota=512.00MB
2021-09-04T16:27:26.203347+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00 sample#load_avg_5m=0.00
2021-09-04T16:27:26.388757+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=303.41MB sample#memory_rss=303.41MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=136850pages sample#memory_pgpgout=65308pages sample#memory_quota=512.00MB
2021-09-04T16:27:53.298080+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00 sample#load_avg_5m=0.00
2021-09-04T16:27:53.420342+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=303.04MB sample#memory_rss=303.03MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=139255pages sample#memory_pgpgout=67810pages sample#memory_quota=512.00MB
2021-09-04T16:28:24.260942+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00 sample#load_avg_5m=0.00
2021-09-04T16:28:24.335250+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=303.17MB sample#memory_rss=303.17MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=143043pages sample#memory_pgpgout=71563pages sample#memory_quota=512.00MB
2021-09-04T16:28:34.215115+00:00 app[web.1]: ga_id= session_id=ZAzUYc3RQw0qaC_WYY7HsWAzKSDns3eY level=info message="PERF         9ms  200 GET /api/flags"
2021-09-04T16:28:34.223076+00:00 app[web.1]: ga_id= session_id=BBB405od-up9xT3Eih7HBmaa9DXRPqSv level=info message="PERF         6ms  200 GET /api/version"
2021-09-04T16:28:34.327288+00:00 app[web.1]: ga_id= session_id=X_BvX13-pLZfjcwBdoJU9p2gI7DkeDYZ level=info message="PERF       103ms  200 GET /api/metrics"
2021-09-04T16:28:34.327479+00:00 app[web.1]: nuxtServerInit store state clearProfile because req.user is not defined
2021-09-04T16:28:34.327529+00:00 app[web.1]: nuxtServerInit req.session.id P8uI2oHHLETSBgLSkGdIbac61yif9Yhq
2021-09-04T16:28:34.327546+00:00 app[web.1]: nuxtServerInit done
2021-09-04T16:28:34.577281+00:00 heroku[router]: at=info method=GET path="/" host=doublecheck.wikiloop.org request_id=badf9423-cf69-45d2-8afb-22dc73247509 fwd="63.143.42.245" dyno=web.1 connect=0ms service=390ms status=200 bytes=70211 protocol=http
2021-09-04T16:28:34.580302+00:00 app[web.1]: ga_id= session_id=P8uI2oHHLETSBgLSkGdIbac61yif9Yhq level=info message="PERF       389ms  200 GET /"
2021-09-04T16:28:54.695341+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00 sample#load_avg_5m=0.00
2021-09-04T16:28:54.743439+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=303.46MB sample#memory_rss=303.46MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=147768pages sample#memory_pgpgout=76214pages sample#memory_quota=512.00MB
2021-09-04T16:29:20.575577+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00 sample#load_avg_5m=0.00
2021-09-04T16:29:20.622321+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=304.17MB sample#memory_rss=304.16MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=150712pages sample#memory_pgpgout=78977pages sample#memory_quota=512.00MB
2021-09-04T16:29:43.094768+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#load_avg_1m=0.00 sample#load_avg_5m=0.00
2021-09-04T16:29:43.152319+00:00 heroku[web.1]: source=web.1 dyno=heroku.130323585.8da86adf-be08-4c4c-877b-de7d04bc777b sample#memory_total=303.32MB sample#memory_rss=303.31MB sample#memory_cache=0.00MB sample#memory_swap=0.00MB sample#memory_pgpgin=153028pages sample#memory_pgpgout=81511pages sample#memory_quota=512.00MB
2021-09-04T16:30:00.006931+00:00 app[web.1]: level=info message="CRON    Start running populateFeedRevisions..."
2021-09-04T16:30:03.278235+00:00 app[web.1]:
2021-09-04T16:30:03.278242+00:00 app[web.1]: <--- Last few GCs --->
2021-09-04T16:30:03.278243+00:00 app[web.1]:
2021-09-04T16:30:03.278245+00:00 app[web.1]: [4:0x42f2fc0]   558199 ms: Mark-sweep 252.4 (258.6) -> 251.6 (258.6) MB, 170.4 / 0.0 ms  (average mu = 0.199, current mu = 0.196) allocation failure scavenge might not succeed
2021-09-04T16:30:03.278245+00:00 app[web.1]: [4:0x42f2fc0]   558396 ms: Mark-sweep 252.5 (258.6) -> 251.8 (258.6) MB, 177.5 / 0.0 ms  (average mu = 0.150, current mu = 0.098) allocation failure scavenge might not succeed
2021-09-04T16:30:03.278246+00:00 app[web.1]:
2021-09-04T16:30:03.278246+00:00 app[web.1]:
2021-09-04T16:30:03.278246+00:00 app[web.1]: <--- JS stacktrace --->
2021-09-04T16:30:03.278246+00:00 app[web.1]:
2021-09-04T16:30:03.278248+00:00 app[web.1]: ==== JS stack trace =========================================
2021-09-04T16:30:03.278248+00:00 app[web.1]:
2021-09-04T16:30:03.278248+00:00 app[web.1]: 0: ExitFrame [pc: 0x1409219]
2021-09-04T16:30:03.278249+00:00 app[web.1]: 1: StubFrame [pc: 0x138a8f4]
2021-09-04T16:30:03.278249+00:00 app[web.1]: 2: StubFrame [pc: 0x1472903]
2021-09-04T16:30:03.278250+00:00 app[web.1]: Security context: 0x33a44c5c08d1 <JSObject>
2021-09-04T16:30:03.278250+00:00 app[web.1]: 3: /* anonymous */ [0x1cab69d52db9] [/app/node_modules/mongoose/lib/document.js:1] [bytecode=0xa9a6d5ecf71 offset=5](this=0x1a3fa5aa1e81 <model map = 0x2fe93b065e19>)
2021-09-04T16:30:03.278251+00:00 app[web.1]: 4: $session [0x1cab69d52579] [/app/node_modules/mongoose/lib/document.js:846] [bytecode=0xa9a6d5ecbc1 offset=51](this=0x1a3f...
2021-09-04T16:30:03.278251+00:00 app[web.1]:
2021-09-04T16:30:03.278255+00:00 app[web.1]: FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
2021-09-04T16:30:03.279017+00:00 app[web.1]: 1: 0xa17c40 node::Abort() [node]
2021-09-04T16:30:03.279629+00:00 app[web.1]: 2: 0xa1804c node::OnFatalError(char const*, char const*) [node]
2021-09-04T16:30:03.280272+00:00 app[web.1]: 3: 0xb95a7e v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [node]
2021-09-04T16:30:03.280858+00:00 app[web.1]: 4: 0xb95df9 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [node]
2021-09-04T16:30:03.281602+00:00 app[web.1]: 5: 0xd53075  [node]
2021-09-04T16:30:03.282321+00:00 app[web.1]: 6: 0xd53706 v8::internal::Heap::RecomputeLimits(v8::internal::GarbageCollector) [node]
2021-09-04T16:30:03.283024+00:00 app[web.1]: 7: 0xd5ffc5 v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::GCCallbackFlags) [node]
2021-09-04T16:30:03.283764+00:00 app[web.1]: 8: 0xd60e75 v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [node]
2021-09-04T16:30:03.284472+00:00 app[web.1]: 9: 0xd6392c v8::internal::Heap::AllocateRawWithRetryOrFail(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [node]
2021-09-04T16:30:03.285164+00:00 app[web.1]: 10: 0xd2a34b v8::internal::Factory::NewFillerObject(int, bool, v8::internal::AllocationType, v8::internal::AllocationOrigin) [node]
2021-09-04T16:30:03.285973+00:00 app[web.1]: 11: 0x106c91e v8::internal::Runtime_AllocateInYoungGeneration(int, unsigned long*, v8::internal::Isolate*) [node]
2021-09-04T16:30:03.286867+00:00 app[web.1]: 12: 0x1409219  [node]
2021-09-04T16:30:03.359090+00:00 heroku[web.1]: Process exited with status 134
2021-09-04T16:30:03.515004+00:00 heroku[web.1]: State changed from up to crashed
2021-09-04T16:30:16.090534+00:00 heroku[router]: at=error code=H10 desc="App crashed" method=GET path="/empty" host=doublecheck.wikiloop.org request_id=2c13f0b7-5265-4fad-9ecb-b99da21e87c7 fwd="216.245.221.88" dyno= connect= service= status=503 bytes= protocol=http
2021-09-04T16:30:41.200419+00:00 heroku[router]: at=error code=H10 desc="App crashed" method=GET path="/" host=doublecheck.wikiloop.org request_id=6b1eed3d-f749-4a69-80e7-e6a193266c43 fwd="63.143.42.245" dyno= connect= service= status=503 bytes= protocol=http
2021-09-04T16:30:45.286293+00:00 heroku[router]: at=error code=H10 desc="App crashed" method=GET path="/revision/enwiki/982629408" host=doublecheck.wikiloop.org request_id=22352dba-a289-47d4-a234-2b0f43425c71 fwd="114.119.146.117" dyno= connect= service= status=503 bytes= protocol=http
2021-09-04T16:32:09.451042+00:00 heroku[router]: at=error code=H10 desc="App crashed" method=GET path="/socket.io/?EIO=3&transport=polling&t=NknfogC" host=wikiloop-doublecheck-prod.herokuapp.com request_id=4313efc2-e2c1-46a3-bb37-d85f98790dcd fwd="98.33.103.124" dyno= connect= service= status=503 bytes= protocol=https
2021-09-04T16:32:16.510254+00:00 heroku[router]: at=error code=H10 desc="App crashed" method=GET path="/socket.io/?EIO=3&transport=polling&t=NknfqYq" host=wikiloop-doublecheck-prod.herokuapp.com request_id=75bad913-5cc4-4054-b6fe-361f35337ac6 fwd="98.33.103.124" dyno= connect= service= status=503 bytes= protocol=https
2021-09-04T16:32:22.496555+00:00 heroku[router]: at=error code=H10 desc="App crashed" method=GET path="/socket.io/?EIO=3&transport=polling&t=Nknfs7x" host=wikiloop-doublecheck-prod.herokuapp.com request_id=708c76c0-e64a-4d84-9486-64d91eec1f2b fwd="98.33.103.124" dyno= connect= service= status=503 bytes= protocol=https
2021-09-04T16:32:28.805089+00:00 heroku[router]: at=error code=H10 desc="App crashed" method=GET path="/socket.io/?EIO=3&transport=polling&t=Nknftby" host=wikiloop-doublecheck-prod.herokuapp.com request_id=f69b94d3-d83b-4355-9030-69a1cd1b3631 fwd="98.33.103.124" dyno= connect= service= status=503 bytes= protocol=https
2021-09-04T16:32:30.169522+00:00 heroku[router]: at=error code=H10 desc="App crashed" method=GET path="/zh" host=wikiloop-doublecheck-prod.herokuapp.com request_id=3ae59dc5-bea5-4e36-b772-79d90e5c67e8 fwd="98.33.103.124" dyno= connect= service= status=503 bytes= protocol=https
2021-09-04T16:32:31.610687+00:00 heroku[router]: at=error code=H10 desc="App crashed" method=GET path="/favicon.ico" host=wikiloop-doublecheck-prod.herokuapp.com request_id=8b98483d-373c-4250-8dcb-af95d1c2a17d fwd="98.33.103.124" dyno= connect= service= status=503 bytes= protocol=https
2021-09-04T16:32:33.247833+00:00 heroku[router]: at=error code=H10 desc="App crashed" method=GET path="/sw.js" host=wikiloop-doublecheck-prod.herokuapp.com request_id=2799cd10-cf0f-47d6-be29-8fc6a6443a40 fwd="98.33.103.124" dyno= connect= service= status=503 bytes= protocol=https

xinbenlv avatar Sep 04 '21 17:09 xinbenlv