csv-validator icon indicating copy to clipboard operation
csv-validator copied to clipboard

Published 20 hours ago • verified publisher icon digital-preservation

Encoding

Open eilandnl opened this issue 5 years ago • 2 comments

Would it be possible to do something with encoding maybe give it as a flag --encoding utf-8-bom

Now i am unable to validate utf-8-bom files

eilandnl avatar Jul 02 '20 07:07 eilandnl

We use the Univocity CSV Parser internally. It does look like we could add a flag as you suggest which would instead use http://docs.univocity.com/parsers/2.7.3/index.html?com/univocity/parsers/common/input/BomInput.html

adamretter avatar Jul 03 '20 09:07 adamretter

As a workaround there are lots of tools available that you can use to strip any BOM from the files before processing them - just do a Google search fro "strip BOM"

adamretter avatar Jul 03 '20 09:07 adamretter