csvs-to-sqlite
csvs-to-sqlite copied to clipboard
simonw
Convert CSV files into a SQLite database
If a large number of regular CSV files are provided within a zip or tar file, it would be useful to be able to use `csvs-to-sqlite` to: - list any...
I'd like to be able to use (awesome) datasette with BCE dates, I think SQLite can support that if using Julian days, so I wanted to be able to create...
I'm processing a 100MB+ file at the moment and there's no indication of how long it will take.
(This is for `csvs-to-sqlite=1.0`, using `Python 3.7`) ## How to reproduce the error Given a CSV that has `table_name` as one of its column headers, e.g. this [OSHA data dictionary.csv](https://github.com/storydrivendatasets/osha-enforcement-catalog/blob/master/data/collected/osha/stash/osha_data_dictionary/osha_data_dictionary.csv)...
Hi @simonw I'm having a hard time applying the shape function. I can use the native .import function, but that brings in everything as text, but I'd love to specify...
Hello, I suggest the deletion of the _fts tables in case of use of the -f and --replace-tables options. Otherwise, an error occurs warning that the _fts tables already exist...
Quite a few options (like `--shape`) are only listed in the `--help` output. This isn't enough information - the README should be expanded.
I'm trying to extract columns using --extract-columns "src_col:dest_table:dest_value_col" but in my dest_table the ID is not 'id' but "tablename_id". What's the best way to get around this issue? I noticed...
I the CSV file uses `\r\n` as it's row ending, the csvs-to-sqlite misses the first column (of data) and shifts the columns "to the left" (and the last column is...
When enabled, `--fts-all` adds FTS to all columns when converting input file to SQLite table. Changed function `generate_and_populate_fts()` in `utils.py` to handle `--fts-all`
