Datamancer icon indicating copy to clipboard operation
Datamancer copied to clipboard

parsing CSV file with 2 empty newlines at end fails

Open Vindaar opened this issue 4 years ago • 1 comments

If there's two empty newlines at the end (so one fully empty line), our CSV parser chokes.

It's a bit difficult, as either we need to check for this in the first line counting pass (slows it down) or reduce the size of the final tensor afterwards. Need to think about the most elegant solution.

To reproduce just take a working CSV file and 2 newlines at the end and run.

Vindaar avatar Jun 24 '21 16:06 Vindaar

This can partially be handled now by using the maxLines option added in #46. Still this particular case should be handled automatically.

Vindaar avatar Dec 02 '22 17:12 Vindaar