gpq icon indicating copy to clipboard operation
gpq copied to clipboard

A collection of tools for mining government data

Government Procurement Queries

A collection of SQL queries that help

  • Selling to the government
  • Learning about competitors
  • Monitoring government spending

The quickest way to find out what it means exactly:

  • Introduction to US Federal Government Contracts

Usage

Data

  • data

The data is collected from government websites and loaded to Google BigQuery:

Data BigQuery dataset Source
US Federal Government contracts (2000–2016) gpqueries:contracts USASpending.gov

For the codebooks, see data.

Queries

  • queries

All queries are written for the BigQuery SQL dialect and stored in .sql files. Each file contains comments about its purpose and usage.

You can execute queries with:

All methods require a Google Account and a Google Cloud Project. Both are free. The first-time setup takes a couple of minutes.

Web GUI is the easiest to start with.

See also: Accessing BigQuery

Notebooks

  • notebooks

Jupyter (IPython) notebooks with replication code and comments:

  • Introduction to US Federal Government Contracts
  • Finding Government Clients in Procurement History

Reports

  • reports

Extracts that highlight particular findings, usually from notebooks.

Coming soon

  • More federal coverage: federal grands, loans, and other assistance
  • Subnational coverage: states and large cities
  • Notebooks for business intelligence and finding government customers

To receive updates, press "Watch" in the top right corner.

Related

Contacts

Anton Tarasenko