pingvin-share icon indicating copy to clipboard operation
pingvin-share copied to clipboard

🚀 Feature: Improve RAM usage of docker image

Open ThowZzy opened this issue 1 year ago • 13 comments

🔖 Feature description

The docker image (0.17.4) uses a lot of ram even thought its not even in use, maybe the database has too big values or something?

image

Would be nice if it was using less ram, and when its in use maybe use a bit more.

ThowZzy avatar Sep 06 '23 07:09 ThowZzy

Thanks for your report. Do you encounter the high usage only since version 0.17.4? And to be sure, the high memory usage isn't while uploading files?

stonith404 avatar Sep 06 '23 09:09 stonith404

I always noticed this usage a bit higher than other more optimized images even in older versions. And no I did not upload yet on this install. To clarify, its not always 400MB, here the current usage, but I think it could still be optimized somehow. image

It's not really a bug but more of an improvement, if it's possible :)

ThowZzy avatar Sep 06 '23 09:09 ThowZzy

I've checked the memory consumption on my arm64 Linux server and on a Windows 10 PC and I got around 200mb RAM usage which is acceptable in my opinion.

docker stats: image

htop inside the container: tempsnip

Would you mind to share these two stats too? For the first one you just have to run docker stats and for the second one you have to to run the following commands:

docker compose pingvin-share bash
apt update && apt install htop
htop

stonith404 avatar Sep 06 '23 12:09 stonith404

Almost the same, a bit more

image

image

I just find it strange for a simple webpage to be the biggest memory consumption compared to all these other sevices image But no, its not ridiculously high

ThowZzy avatar Sep 06 '23 12:09 ThowZzy

Yeah I mean it's still not perfect but in my opinion it's acceptable. Do you think we could convert this bug report into a enhancement?

stonith404 avatar Sep 08 '23 09:09 stonith404

Yeah I mean it's still not perfect but in my opinion it's acceptable. Do you think we could convert this bug report into a enhancement?

Yes

ThowZzy avatar Sep 08 '23 09:09 ThowZzy

On version:0.18.1 Unraid version 6.12.4

When downloading large files my server's RAM completely fills up until the program crashes, is this related?

image

BBergle avatar Sep 26 '23 00:09 BBergle

Sur la version :0.18.1 version non raidée 6.12.4

Lors du téléchargement de fichiers volumineux, la RAM de mon serveur se remplit complètement jusqu'à ce que le programme plante, est-ce lié ?

image

I have the same problem during upload and download pingvin consumes the entire ram and crashes the program with a permature close

babsz02 avatar Feb 26 '24 21:02 babsz02

@babsz02 The premature error is probably related to #354.

stonith404 avatar Feb 27 '24 08:02 stonith404

@stonith404 In my case, the premature error occurs when the ram is used to 95% when I download large files. However, by disabling proxo-buffuring in my swag config, I can download small files without any problem. The problem comes when uploading and downloading large files.

babsz02 avatar Feb 27 '24 08:02 babsz02

This might be part of the #354. I'll try to test it again with the 24GB file that caused Premature error on the latest 0.22.2 image.

axiomen avatar Mar 04 '24 10:03 axiomen

I downloaded a 24 GB file, and did not encounter the same memory problem as @BBergle on my Unraid host. Neither did I experience the Premature error.

axiomen avatar Apr 05 '24 10:04 axiomen

Thanks, @axiomen. Could you guys try it again, too?

stonith404 avatar Apr 05 '24 12:04 stonith404