scraperwiki-python icon indicating copy to clipboard operation
scraperwiki-python copied to clipboard

`unique_keys` doesn't work for buffered data

Open jfilter opened this issue 5 years ago • 0 comments

The whole idea around unique_keys=["col"] doesn't work for buffered rows. Since not all modifications are committed directly to the database, this make the unique constraint working unreliably.

To make it work, you have to commit transactions manually after each modification.

scraperwiki.sqlite.commit_transactions()

jfilter avatar Sep 01 '20 14:09 jfilter