scrapoxy icon indicating copy to clipboard operation
scrapoxy copied to clipboard

Scrapoxy Memory Leak

Open anisgandoura opened this issue 7 years ago β€’ 3 comments

Hello, After using scrapoxy for a while, I have noticed that the node process was causing a memory leak. I am running the program on a 3Gio RAM, it is all consumed after approximately 2-3 hours leading to a VM crash. Did someone experience the same issue please ?

time 1 time 2

Thank you Anis

anisgandoura avatar Jun 22 '17 20:06 anisgandoura

Hello, Some additional info concerning the bug. It happens when I use scrapoxy to scrap websites downloading videos in the background, this triggers this portion of the scrapoxy code causing a memory leak:

socket.on('error', (err) => { winston.error('[Master] Error: socket error from client (%s %s on instance %s):', req.method, req.url, instance.toString(), err); });

I did a workaround for the moment which is blacklisting the website videos.web-site.com:443 but the bug remains.

I think we should kill the socket at this moment, but I have tried all the combinations without success

anisgandoura avatar Jun 26 '17 23:06 anisgandoura

hello @anisgandoura , does it happen again ? thx, fabien

fabienvauchelles avatar Dec 09 '17 09:12 fabienvauchelles

Hello,

The sub-domain blacklisting workaround has stabilized the server for the last 5 months but the bug is still here yes.

Anis

anisgandoura avatar Dec 09 '17 11:12 anisgandoura

should be different in 4.0.0

fabienvauchelles avatar Oct 04 '23 21:10 fabienvauchelles

Hey there! 🌟 Exciting news! Scrapoxy 4 is ready to rock πŸš€. Check it out at Scrapoxy.io (explore the "get started" guide, deployment documentation, and more πŸ“š). I can't wait to hear your feedback on this new version! Send me your coolest screenshots with as many proxies as possible! πŸ“ΈπŸ’» Join the Discord community if you have any questions or just want to chat. You can also open a GitHub issue for any bug or feature request 🐞✨. See you soon! 😎 Fabien

fabienvauchelles avatar Dec 12 '23 22:12 fabienvauchelles