We stream new data in as the sources publish it. typically, every 5 minutes.
We collect from a lot of sources, so nearly every minute something is updating.
1,501 karma · joined October 18, 2011
https://gridstatus.io/live
https://twitter.com/maxk
We collect from a lot of sources, so nearly every minute something is updating.
We have generation mix, load, and pricing data. Both real time and historical
One consequence of having many market participants is the availability of data that is published to make the markets function.
If you’re interested in seeing more about the real-time operations, I built a site that tracks all this data: https://www.gridstatus.io/live
Grid Status is one of the most widely used energy data platforms in the world. Our data has been used in reporting and analysis by the Wall Street Journal, New York Times, the Federal Reserve, and by thousands of users who regularly visit our products every month.
As one of the first members of our engineering team, you will have a hand in both defining and implementing the product we deliver to customers. No experience in the energy industry is necessary—just a strong eagerness to learn. Our team’s passion and expertise will help you quickly get up to speed.
Our stack is mostly: python, react, postgres, snowflake, AWS
Job posting: https://gridstatus.notion.site/Senior-Software-Engineer-7a2a...
To apply: email us at jobs@gridstatus.io with a resume, link to any projects, and why you're a fit for the role.
If you like grid data, we have a lot more info for the entire country here: https://www.gridstatus.io/live
Grid Status is one of the most widely used energy data platforms in the world. Our data has been used in reporting and analysis by the Wall Street Journal, New York Times, the Federal Reserve, and by thousands of users who regularly visit our products every month.
As one of the first members of our engineering team, you will have a hand in both defining and implementing the product we deliver to customers. No experience in the energy industry is necessary—just a strong eagerness to learn. Our team’s passion and expertise will help you quickly get up to speed.
Our stack is mostly: python, react, postgres, snowflake, AWS
Job posting: https://gridstatus.notion.site/Senior-Software-Engineer-7a2a...
To apply: email us at jobs@gridstatus.io with a resume, link to any projects, and why you're a fit for the role.
New solar records are done until next summer but still interesting stuff happening. For example, California hit a new battery charging record a few weeks ago.
All the records and more real time information about US grid are here: https://www.gridstatus.io/records
Ultimately, the solar eclipse this weekend came and went without any noticeable impact for consumers of electricity. In my opinion, this is a very notable feat.
A well-planned and executed response by grid operators to a predictable eclipse bodes well for a future where events like a particularly cloudy day, blizzard conditions across a large area, or widespread hail damage to solar farms could reduce generation by similar MW values in the middle of the day.
As the grid becomes a more dynamic and volatile place, making operational and investment decisions based on data is more important than ever before.
If this sort of stuff interests you be sure to check out our other dashboards: https://www.gridstatus.io/home
We focus on the United States, so we can have the deepest coverage for each of the regions. In some cases that means were the same as Electricity Maps. In other case, you'll see our data is more real time without relying on estimations.
We have a lot more than generation mix data. For the wholesale energy markets, we also have all the pricing data[1]!
In case you're curious we also have an open source library: https://github.com/kmax12/gridstatus
We'd love to expand, but every new region is hard to support in the same depth as what we currently have in the US
also, if anyone else has this problem please comment / email me max@gridstatus.io
My focus right now is to make this data more available and easier to use. Haven’t done much to monetize yet. If you just want that data source, happy to get it to you for free. Shoot me an email at max@gridstatus.io or sign up for a free api key and grab it from the site
In fact, renewable generation regularly hit more than 100% of load in California during April and June of this year. The peak was 132% of load [0]!
How can generation be more than 100% of load? California was exporting power to other regions.
We track all this data and more across the United States at Grid Status: https://www.gridstatus.io/home
[0] https://www.gridstatus.io/records/caiso?record=Maximum%20Ren...
However, renewables like solar and wind come with unique challenges due to their intermittent nature. They are more variable, harder to forecast, have location constraints, and can benefit from battery storage. These factors lead to a more dynamic grid than before.
For instance, several regions in the country provide five-minute updates on their energy generation mix, enabling near real-time observations of renewable energy effects throughout the day
For example, numerous regions across the country provide updates on their energy generation mix at five-minute intervals, allowing for close to real time observations of these effect of renewables throughout the day.
To help those involved in the energy transition, I created an open-source project called Grid Status (https://github.com/kmax12/gridstatus) that provides fuel mix, wholesale pricing, load, load forecasts, and more.
Additionally, I've developed real-time visualizations to make this data more accessible and easier to comprehend: https://www.gridstatus.io
I hope making this data more accessible and understandable will accelerate the transition away from fossil fuels.
It seems to me a lot of the barriers to adoption in the US are lack of awareness from consumers and widespread support from installers. The equipment for a heat pump shouldn’t be much more expensive then an air conditioner since they share so many parts, but that isn’t the case in practice.
I think government regulations that encourage heat pumps manufacturing and installation are part of the solution. For examples, Biden administration recently issued orders to use the Defense Production Act to produce heat pumps [0] or NYC banning new natural gas hook ups for heating [1].
The other part of heat pumps adoption is making them exciting for consumers. It feels like if you get the right combo of all of that, heat pumps could be the next electric vehicle.
I only recently learned about heat pumps and found it difficult to understand how they worked and potential benefits. Towards that end, I started hacking on this tool for others to get that info: https://www.heatpumpswork.com
[0] https://www.whitehouse.gov/briefing-room/presidential-action...
[1] https://www.theverge.com/2021/12/15/22837799/new-york-city-b...
The Alteryx Innovation Labs creates next generation technologies, tools, and products to unleash the full potential of machine learning. We’re building automation technology to make machine learning easier to use. We work on many unique and important machine learning challenges with a focus on making sure machine learning isn’t just a theoretical endeavor but has a real-world impact.
Currently, our stack is mostly Python, Scala, and React. We use AWS and docker for deployment. Above all, we prioritize the ability to choose the right approach to solve a problem.
For anyone interested in seeing more about how it works, here's the github [0] and documentation [1]
We’re building automation technology to make machine learning easier to use. We work on many unique and important machine learning challenges with a focus on making sure machine learning isn’t just a theoretical endeavor but has a real-world impact.
Currently, our stack is mostly Python, Scala, and React. We use AWS and docker for deployment. Above all, we prioritize the ability to choose the right approach to solve a problem.
The Alteryx Innovation Labs creates next generation technologies, tools, and products to unleash the full potential of machine learning.
We’re building automation technology to make machine learning easier to use. We work on many unique and important machine learning challenges with a focus on making sure machine learning isn’t just a theoretical endeavor but has a real-world impact.
Currently, our stack is mostly Python, Scala, and React. We use AWS and docker for deployment. Above all, we prioritize the ability to choose the right approach to solve a problem.
The Alteryx Innovation Labs creates next generation technologies, tools, and products to unleash the full potential of machine learning.
We’re building automation technology to make machine learning easier to use. We work on many unique and important machine learning challenges with a focus on making sure machine learning isn’t just a theoretical endeavor but has a real-world impact.
Currently, our stack is mostly Python, Scala, and React. We use AWS and docker for deployment. Above all, we prioritize the ability to choose the right approach to solve a problem.
With compose, a user defines a labeling function, and then compose scans the historical data looking for training examples to train a machine learning model.
The library has evolved as we apply it to more and more real world use cases, but it is based on approach in this paper from 2016: https://dai.lids.mit.edu/wp-content/uploads/2016/08/07796929....
The Alteryx Innovation Labs creates next generation technologies, tools, and products to unleash the full potential of machine learning.
We’re building automation technology to make machine learning easier to use. We work on many unique and important machine learning challenges with a focus on making sure machine learning isn’t just a theoretical endeavor but has a real-world impact.
Currently, our stack is mostly Python, Scala, and React. We use AWS and docker for deployment. Above all, we prioritize the ability to choose the right approach to solve a problem.
One man came to Mozart and asked him how to write a symphony. Mozart replied, “You are too young to write a symphony.” The man said, “You were writing symphonies when you were 10 years of age, and I am 21.” Mozart said, “Yes, but I didn’t run around asking people how to do it.”