sqlite-diffable
sqlite-diffable copied to clipboard
simonw
Tools for dumping/loading a SQLite database to diffable directory structure
I've been using this package to build my website for a while and it's been absolutely great! I normally call the package through the CLI as intended but recently created...
e.g. for the binary `numbits` column in the `.coverage` SQLite database generated by `coveragepy`. Those currently end up represented like this: ``` [4, 1, "b'\\xfe\\xff\\xfd{\\xe0\\x02\\x10\\x00W}o\\xdb{\\xef}o\\xef\\xbd\\xf7\\x92\\xe8\\x00\\x00\\xca\\t\\xe0\\xfb\\xdf\\x07y\\xdb\\xbe\\xf3\\x97s\\xd7\\xd8\\xeb\\x06\\xd9Y\\x16A\\x17\\xe6\\x02\\x02 @\\x08\\x10\\x00\\xbcH\\xc1$@\\xf7}?\\x01\\x04 \\x00\\x00\\x00\\x00\\x04%\\x00\\x04\\x00\\x00\\x00\\x00\\x00
Hi, great tool, this is exactly what I'm looking for. I do however have an issue when using AUTOINCREMENT columns. If you create a table like this CREATE TABLE IF...
Inspired by the Who's On First directory layout: https://github.com/whosonfirst-data/whosonfirst-data-admin-us/tree/master/data I'll have an option for "dump each row as a file in a directory named after the table" and a separate...
E.g. a table called `foo/bar` should be dumped to a predictable filename. I'll probably use the same trick as Datasette for this. https://github.com/simonw/datasette/blob/f0d32da0a9af87bcb15e34e35424f0c0053be83a/tests/test_utils.py#L202-L215
The pull list of changes are described in Issue #9, the summary can be found below: - Created wrapper functions for `load`, `dump` and `object` using click and sample code...