theyworkforyou icon indicating copy to clipboard operation
theyworkforyou copied to clipboard

Update parser documentation

Open RichardTaylor opened this issue 2 years ago • 1 comments

The documentation at

https://parser.theyworkforyou.com/parser.html

is out of date.

Ticket noted in light of correspondence asking how TWFY currently obtains information and the related https://github.com/mysociety/parlparse/issues/160 which indicates the documentation is out of date.

RichardTaylor avatar Sep 05 '22 10:09 RichardTaylor

Some related text:

The prime current source of Parliamentary data is the .zip files obtained via

https://github.com/mysociety/parlparse/blob/master/pyscraper/unpack_hansard_zips.py

As you can see from that we use the feed at

http://api.data.parliament.uk/resources/files/feed?dataset=12

That feed doesn't cover Written Questions or Statements which we get from:

https://writtenquestions-api.parliament.uk/index.html

Depending on what you are seeking to do you might find the structured
data made available via

https://www.theyworkforyou.com/api/

or

http://parser.theyworkforyou.com/hansard.html

of use.

If you are considering working with data from Parliament directly you might want to check with Parliament what data sources they are formally offering, and planning to maintain. The main feed we use does not appear to be publicly listed at the moment. We don't know why that is.

See:

https://explore.data.parliament.uk/

and

https://developer.parliament.uk/

RichardTaylor avatar Sep 06 '22 10:09 RichardTaylor