gpq
gpq copied to clipboard
A collection of tools for mining government data
Government Procurement Queries
A collection of SQL queries that help
- Selling to the government
- Learning about competitors
- Monitoring government spending
The quickest way to find out what it means exactly:
- Introduction to US Federal Government Contracts
Usage
Data
data
The data is collected from government websites and loaded to Google BigQuery:
| Data | BigQuery dataset | Source |
|---|---|---|
| US Federal Government contracts (2000–2016) | gpqueries:contracts | USASpending.gov |
For the codebooks, see data.
Queries
queries
All queries are written for the BigQuery SQL dialect and stored in .sql files. Each file contains comments about its purpose and usage.
You can execute queries with:
- BigQuery Web GUI
- Google Datalab
- Google Cloud Platform SDK:
bqtool (seebq help queryfor details)
All methods require a Google Account and a Google Cloud Project. Both are free. The first-time setup takes a couple of minutes.
Web GUI is the easiest to start with.
See also: Accessing BigQuery
Notebooks
notebooks
Jupyter (IPython) notebooks with replication code and comments:
- Introduction to US Federal Government Contracts
- Finding Government Clients in Procurement History
Reports
reports
Extracts that highlight particular findings, usually from notebooks.
Coming soon
- More federal coverage: federal grands, loans, and other assistance
- Subnational coverage: states and large cities
- Notebooks for business intelligence and finding government customers
To receive updates, press "Watch" in the top right corner.
Related
- Social Media Queries - A collection of SQL queries to social media datasets.
Contacts
Anton Tarasenko