Parsing big files: worker runs out of memory with no error message

[adrisanchu]

In which part of the interface would this feature applies? [x] 1. Load your data [ ] 2. Choose a chart [ ] 3. Mapping [ ] 4. Customize [ ] 5. Export

Is your feature request related to a problem? Please describe. I have tried to parse a 300MB .csv file (8800 rows x 2000 cols). In the UI, the "Data parsing options" panel is shown, but the data is not displayed as the worker is running out of memory, so the page looks like if it is broken. I got the following message in the console: eee DOMException: Failed to execute 'postMessage' on 'Worker': Data cannot be cloned, out of memory.

Describe the solution you'd like It would be great to change the UI if the postMessage from the worker sends an 'out of memory' message, and tell the user something like "sorry, your file is too big to be processed". Maybe with a modal window?

Describe alternatives you've considered I don't know which parser you are currently using (I checked the code but it refers to a core package of your own), but papaparse is a good option to parse big files in the frontend.

Additional context Here is a screenshot of the page after dropping the file