seed icon indicating copy to clipboard operation
seed copied to clipboard

Export to CSV is timing out for large dataset

Open RDmitchell opened this issue 5 years ago • 4 comments

Expected Behavior

Export data from the Inventory List view using the Action / Export option, selecting CSV

Actual Behavior

From the UI perspective, nothing happens -- no error message saying the program timed out, but no file is downloaded

Steps to Reproduce

image

See this doc https://docs.google.com/document/d/1Pq173YSOSi__WpwSP4_-qDsuk3X7sB-TEuEZYY6YTjw/edit?usp=sharing

Instance Information

Instance: LBNL staging SHA: d810c466 (2.5.0 release)

RDmitchell avatar Apr 19 '19 01:04 RDmitchell

Instance: seedv2 SHA: 9a2a5813 (2.5.2 release)

Property Records

  • 2017: 15,438 records, 19 fields
  • Exported without issue, all records

Tax Lot Records

  • 2017: 24,238 records, 200+ fields
  • 504 Gateway timeout error

Instance: seeddemostaging SHA: e120119f (2.6.0 release)

Property Records

  • 2017: 15,438 records, 19 fields
  • Exported without issue, all records

Tax Lot Records

  • 2017: 24,238 records, 200+ fields

  • 504 Gateway timeout error

  • reduced # fields to 100+, then 48, then 16, then 1 (!)

  • 504 error

So it seems that 24,000+ records is too many


Instance: dev1.seed-platform.org SHA:

Property Records

  • 2017: 15,438 records, 19 fields
  • exported fairly quickly, no errors.

Tax Lot Records

  • 2017: 24,238 records, 200+ fields
  • Error 524 -- Cloudflare timeout

RDmitchell avatar Aug 22 '19 20:08 RDmitchell

This issue has been automatically marked as stale because it has not had recent activity within 60 days. It will be closed if no further activity occurs. Thank you for your contributions.

github-actions[bot] avatar Oct 15 '22 02:10 github-actions[bot]

I will test on the latest dev version

RDmitchell avatar Oct 18 '22 19:10 RDmitchell

Still a problem. Using the new Property List, Property tab, selected all records (15000+) and as soon as I typed a name into the CSV dialog box program responded with 520 error

Image

See this doc https://docs.google.com/document/d/1Pq173YSOSi__WpwSP4_-qDsuk3X7sB-TEuEZYY6YTjw/edit?usp=sharing

RDmitchell avatar Oct 19 '22 23:10 RDmitchell

This issue has been automatically marked as stale because it has not had recent activity within 60 days. It will be closed if no further activity occurs. Thank you for your contributions.

github-actions[bot] avatar Dec 19 '22 01:12 github-actions[bot]

@RDmitchell Is this still an issue?

isalanglois avatar May 19 '23 21:05 isalanglois

@isalanglois -- I just assigned myself to test this.

RDmitchell avatar May 22 '23 18:05 RDmitchell

Instance: LBNL Staging SHA: de3b9d486 (2.18.1) Org: NYC

Using the New Property List option (not Legacy), View property tab, checked all the records, and set “select all” on the right, then used the Action menu to do the export

It got to 100%, then reported a 504 error -- so this is still an issue image

RDmitchell avatar May 24 '23 19:05 RDmitchell

@isalanglois -- this is still an issue, so I moved it to the Q4 project

RDmitchell avatar May 24 '23 19:05 RDmitchell