François Briatte

Look at robots.txt

1

https://rud.is/b/2017/09/25/speeding-up-digital-arachinds/

https://towardsdatascience.com/ethics-in-web-scraping-b96b18136f01

- ~~[ParlGov](http://www.parlgov.org/) stable __2015__ edition was released 12 March 2016.~~ - [ParlGov](http://www.parlgov.org/) stable __2018__ edition was released 1 May 2018. See the [ParlGov changelog](http://www.parlgov.org/documentation/changelog/). See also #19.

- [ ] Add code to concatenate party acronym to start year of legislature - [ ] Make `parties.r` files follow ParlGov scores across time - [ ] Show variations...

Write stricter code with - https://github.com/r-lib/conflicted - https://github.com/hadley/strict Also take into account: https://github.com/jimhester/falsy

- Use `robotstxt::get_robotstxt` - [Example](https://rayms.github.io/2018-01-04-election-observers/) See also #14

https://fs.r-lib.org/

… in order to list blog posts that explain government coalitions over covered period. Example sources: - Same as ParlGov (Reuters etc.) - The Monkey Cage, e.g. [this post on...

- [ ] Use [tibbles](https://cran.r-project.org/web/packages/tibble/) for data frames. - [ ] Use [pointblank](https://github.com/rich-iannone/pointblank) columns validation. See also #4

See e.g. #2 #3 and various suggestions in each country-specific scraper.