Chris Mytton

> - Fuzzing of fields is done record by record The drawback of this approach is that we can't rank the matches to have the most near-100% matches shown to...

I've been investigating this today and it seems that parsing the JSON from Wikidata is using up a lot of memory. I've put together a [minimal test case](https://github.com/chrismytton/wikisnakker-memory-benchmark/blob/e364ad01c6170582fc4357d084a09344903bbeb0/json_test.rb) that uses...

This is related to coming up with an elevator pitch for Scraped, https://github.com/everypolitician/scraped/issues/45, as I think a big part of this will be encouraging people to use Scraped on the...

I've done a prototype of an `Everypolitician::Scraper` class in the Romanian scraper https://github.com/everypolitician-scrapers/romanian-parliament/pull/8 and the same code is running in the Japan scraper (which is a slightly unusual one) https://github.com/everypolitician-scrapers/japan/pull/4....

~~We need to extract the logic for fetching sources into separate library first - https://github.com/everypolitician/everypolitician/issues/587 - that should then unlock this.~~ UPDATE: Realised this isn't actually needed because we've got...

Done for internal pull requests here - https://github.com/everypolitician/app-manager/pull/40

Bumping this back up the stack as it's needed again. # Problem Since merging https://github.com/everypolitician/rebuilder/pull/71 all new pull requests created by the bot on everypolitician-data are missing the commit to...

Notes from Slack conversation with @tmtmtmtm about this: ## Switch to doing per-legislature or per-country index.json files Eventually we want to end up with an `index.json` file in the country...

What format do you think the intermediate collections will be stored as, Popolo? We've discussed before possibly having some other intermediate format, either one we make up or something closer...

> We should separately build each collection, and sub-collection (i.e. Events should be built by combining Terms and Elections, each of which is built separately). What about other things that...