gcsf icon indicating copy to clipboard operation
gcsf copied to clipboard

Out of memory: Killed process xxxx (gcsf)

Open ddonindia opened this issue 4 years ago • 5 comments

While copying large (4GB) file from mounted folder to my local disk I am seeing OOM kill.

Looks like gcsf is keeping all files in memory. I tried reducing values of cache_max_seconds , cache_max_items and cache_statfs_seconds but noo luck.

ddonindia avatar Mar 31 '20 13:03 ddonindia

That's true, and unfortunately there's no easy fix since this issue stems from a design decision.

harababurel avatar Apr 09 '20 13:04 harababurel

Ok. Sorry mate I had to switched to rclone

ddonindia avatar Apr 09 '20 20:04 ddonindia

I'll take a look into the source code when I get to it. On a Raspberry PI this is a real issue since there is not lot of memory available. I have a 750MBit fiber line so mounting a Google drive would make sense for storage that's not speed critical. (I'm paying a lot annually for that 2TB anyway so buying more storage seems a waste of money.)

sanderPostma avatar May 12 '20 19:05 sanderPostma

I think rclone chunks the files every 10mb to avoid this issue. Is it maybe possible to implement chunks in gcsf too?

martinszy avatar Oct 12 '20 14:10 martinszy

It might be a possible solution to explore. For now you might be able to get around by setting a trivial cache limit (cache_max_items = 0, cache_max_seconds = 0). The only limitation with this is that you can only access a file if it would fit in your available RAM.

harababurel avatar Jul 24 '23 11:07 harababurel