scrapoxy
scrapoxy copied to clipboard
Scrapoxy Memory Leak
Hello, After using scrapoxy for a while, I have noticed that the node process was causing a memory leak. I am running the program on a 3Gio RAM, it is all consumed after approximately 2-3 hours leading to a VM crash. Did someone experience the same issue please ?


Thank you Anis
Hello, Some additional info concerning the bug. It happens when I use scrapoxy to scrap websites downloading videos in the background, this triggers this portion of the scrapoxy code causing a memory leak:
socket.on('error', (err) => { winston.error('[Master] Error: socket error from client (%s %s on instance %s):', req.method, req.url, instance.toString(), err); });
I did a workaround for the moment which is blacklisting the website videos.web-site.com:443 but the bug remains.
I think we should kill the socket at this moment, but I have tried all the combinations without success
hello @anisgandoura , does it happen again ? thx, fabien
Hello,
The sub-domain blacklisting workaround has stabilized the server for the last 5 months but the bug is still here yes.
Anis
should be different in 4.0.0
Hey there! π Exciting news! Scrapoxy 4 is ready to rock π. Check it out at Scrapoxy.io (explore the "get started" guide, deployment documentation, and more π). I can't wait to hear your feedback on this new version! Send me your coolest screenshots with as many proxies as possible! πΈπ» Join the Discord community if you have any questions or just want to chat. You can also open a GitHub issue for any bug or feature request πβ¨. See you soon! π Fabien