slurp icon indicating copy to clipboard operation
slurp copied to clipboard

💭 Scraping config file discussion 💭

Open jbampton opened this issue 6 years ago â€ĸ 2 comments

For the website profiles we scrape we need to store the profile user names in a config file.

I was previously using CSV on another project.

We could use XML, JSON, YAML, CSV or ?

jbampton avatar Dec 09 '19 17:12 jbampton

Json

Andrew-Colman avatar Dec 09 '19 20:12 Andrew-Colman

As a data storage format, CSV has problems, but it is more easily and more widely used than the other formats you mention (XML, JSON, YAML). If the file must be prepared manually, then CSV is a sensible format to use. If the file is to be prepared only using a tool, then the tool can do the work, and a different format may be a better option.

prestonhunter avatar Dec 11 '19 20:12 prestonhunter