Chris Mytton

I've started a branch for this here: https://github.com/mysociety/fixmystreet/compare/add-send-state-to-problems At the time of writing it's just got the DB migrations in there. Next steps are to update the report sending code...

You can also install this with pip using this oneliner: ``` pip install git+https://github.com/RhetTbull/dogsheep-photos.git@update_for_bigsur ```

> I assume this will all be squashed together given the changes Yep will squash it all together once it's been reviewed. > I see the 'last collection' is also...

@MorayMySoc Can this be closed now https://github.com/mysociety/fixmystreet/pull/4796 has been merged?

This should now be fixed by the changes in https://github.com/mysociety/fixmystreet/commit/6d15fc86630a07366565ed055a302cc858cff588.

This script has now been pulled into a shared repository - https://github.com/everypolitician/ensure-regression-tests. Here's an example of switching Scraped to use that script - https://github.com/everypolitician/scraped/pull/71, should be fairly similar to add...

I wonder if it would be better to simply output one JSON file for the whole scraper run, rather than have one JSON file per page scraped? If we had...

👍 that makes sense. I guess if at some point in the future we _did_ want one big data dump then it's easier to generate that from the individual JSON...

We have a couple of other options instead of creating or updating our own reconciler: - [Mix'n'match](https://tools.wmflabs.org/mix-n-match/) tool from Wikimedia Labs - [OpenRefine](http://openrefine.org/) Using external tools would certainly save us...

Plan for initial version: - Upload two CSV files in HTML interface - One file represents the **incoming** data to be matched - One file represents the **existing** data to...