fromthepage icon indicating copy to clipboard operation
fromthepage copied to clipboard

timeout on large collaborator reports

Open saracarl opened this issue 2 years ago • 0 comments

Christina at MO says:

I have attempted to create/download the collaborator activity for the slave schedule project as a csv a couple times and keep getting an error. I’m assuming its since it is a large file.

We hopped on a screenshare and watched; she's getting a "no results" or no data sort of http error; it seemed like a timeout to us.

She was running this on the Missouri Slave Schedules collection from April 1, 2021 - June 1, 2022. The timeout occurred twice -- once after setting the date range (just the work to display the data on the page) -- this is the URL with the error then: https://fromthepage.com/missouristatearchives/missouri-slave-schedules/collaborators?collection_id=%23%3CCollection%3A0x00007f36ba720770%3E&start_date=Apr+01%2C+2021&end_date=Jun+01%2C+2022&commit=Update

and another time when trying to download the collaborator report from that page. This is the URL with the error then: https://fromthepage.com/collection/activity_download?collection_id=1203&end_date=Jun+01%2C+2022&start_date=Apr+01%2C+2021

This issue is not time critical -- we were able to run the report and send it to Christina offline, and she'll let us know if they need any additional ones in the future.

We think we'll have to rearchitect our approach here; the second (download report) request we'll probably background and send in email like we do exports; the first we're not sure what we can do to speed up the resulting page with large amounts of data.

saracarl avatar Oct 04 '22 15:10 saracarl