adhocracy4 icon indicating copy to clipboard operation
adhocracy4 copied to clipboard

xlsx export buffers in memory

Open ihucos opened this issue 7 years ago • 6 comments

but it should be streamed

here is the code https://github.com/liqd/adhocracy4/blob/master/adhocracy4/exports/views.py#L19 It should be ok for a while, since we are hosting our own servers we can have plenty of memory per request and its a feature that is not used a lot at once. So this is also a problem where we wait for it come to us before solving it. Ha but on the other hand since this should be an open source base component we could fix it because in other setups this would not work (more db entries, different hosting)

The easiert solution is probably to buffer it in a file, send the file, then delete it

ihucos avatar May 16 '18 07:05 ihucos

Also, this will be the problem with the cut off comments?! Good catch!

fuzzylogic2000 avatar May 16 '18 08:05 fuzzylogic2000

I talked with Robert, in our infrastructure we should not run into any kind of problems since we have plenty of RAM per request. If you mean with cut off comments, that the file is incomplete or that there are comments missing, I don't think that problem would be related to this issue.

ihucos avatar May 16 '18 08:05 ihucos

:(

fuzzylogic2000 avatar May 16 '18 08:05 fuzzylogic2000

Removing a single line: https://github.com/liqd/adhocracy4/blob/master/adhocracy4/exports/views.py#L27 We would buffer the export in a file, but as talked with @treba123 (Robert) that would also not be so nice.

ihucos avatar May 16 '18 08:05 ihucos

@goapunk Uh, we already have an issue for this. :)

fuzzylogic2000 avatar Mar 06 '23 12:03 fuzzylogic2000

a rather old one ;-)

goapunk avatar Mar 06 '23 12:03 goapunk