csvs-to-sqlite
csvs-to-sqlite copied to clipboard
simonw
Convert CSV files into a SQLite database
I am trying to load 18 CSV files from CorpWatch into a SQLite database using csvs-to-sqlite. I will spare you the deprecation warnings for `error_bad_lines`. ``` michael$ time /Users/michael/Library/Python/3.8/bin/csvs-to-sqlite ~/Downloads/corpwatch_api_tables_csv...
I have a CSV detailing info about airports. The country code column is encoded using 2 character ISO-3166 codes. https://en.wikipedia.org/wiki/List_of_ISO_3166_country_codes It turns out that the code for Namibia is "NA"...
Hi, `csvs-to-sqlite` suggests to use `low_memory=False`, but there is no way to use such option from the command line, and it is not mentioned in the documentation. ``` /home/user/.local/pipx/venvs/csvs-to-sqlite/lib/python3.8/site-packages/csvs_to_sqlite/utils.py:38: DtypeWarning:...
I get a deprecation warning on the latest stable. ``` csvs_to_sqlite/utils.py:38: FutureWarning: The error_bad_lines argument has been deprecated and will be removed in a future version. Use on_bad_lines in the...
Lots of CSV files have informally declared metadata in the first few lines of the file, and footnotes at the end. It would be useful to have an explicit way...
As per issue #80: https://github.com/simonw/csvs-to-sqlite/issues/80 Tested in 3.x, including 3.10. Seems fine.
it's generally easier to if the column names of a sqlite table are lower case, have no spaces, and have no reserved characters. It would be nice if there was...
Right now, the setup.py pins Click to version 7.x, which makes it impossible to use version 8.x. Here is the changelog for Click 8.0.0: https://click.palletsprojects.com/en/8.0.x/changes/
Wanted to see if there is interest in a patch that helps speed up our workflows significantly, or if there are any further ideas for improving on such a feature....
