17 years of government contracts on BigQuery
github.com
github.com
1. It has a separate "storage tier" and "compute tier", so we can all run queries against the same dataset at the same time.
2. The "compute tier" is 100% shared, so I can use BigQuery even if I just want to run a few queries.
I hope we'll see more projects like this. Having public data available in SQL is a great thing. SQL is easy enough that a lot of people can figure it out, but powerful enough to do real work.
Check out this as well: https://cloud.google.com/bigquery/public-data/ https://www.reddit.com/r/bigquery/wiki/datasets
Full disclosure, I work for Graphiq which owns InsideGov.
We're looking to move to GCP and love what's there so far but need some help from the startup side.
But you can do an "advanced search" by registered company name, and this is what comes up for "Microsoft" -- probably doesn't include all of its subsidiaries that don't have "Microsoft" in the name: ~$1.4 billion in awarded contracts
https://www.usaspending.gov/Pages/AdvancedSearch.aspx?sub=y&...
edit: Oh I know the reason for the discrepancy...the homepage of the beta app says it's only partial data:
> Added more years of contract data to now include 2011 - 2015
1. Agencies often buy from distributors and integrators, not publishers. In this case, original manufacturers may appear in the variable `descriptionofcontractrequirement`.
2. Spelling may differ. Variable `dunsnumber` is be a better indicator for uniqueness.
A search on sam.gov for "lockheed" results in 207 records (all probably the same company).
Fixing the link for mobile: (GitHub doesn't render the link)
- http://nbviewer.jupyter.org/github/antontarasenko/gpq/blob/m...
Some quick charts with DataStudio (https://medium.com/@hoffa/showing-off-the-new-free-google-an...):
That said, there are plenty of open source projects that scale horizontally and let you run SQL faster than RDBMS - Presto, Impala, Spark, Druid, Hive, etc.
Happy to answer more questions on BigQuery.