Hacker News Reader

Comment by roelschroeven | Hacker News Reader

What data is used to train this AI? The article doesn't say anything about that (tough I have to admit I didn't read it super carefully). My first thought would be exactly all this historical data, but then you can't use that same data to test the AI's performance. Are different subsets of the available historical data used for training vs testing?

View on HN

It's most likely ERA5: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-s...

No, they say end-to-end, meaning they use raw obsevations. Most or all other medium-range models start with ERA5.

There's a paper from Norway that tried end-to-end, but their results were not spectacular. That's the aim of many though, including ECMWF. Note that ECMWF already has their AIFS in production, so AI weather prediction is pretty mainstream nowadays.

Google has a local nowcast model that uses raw observations, in production, but that's a different genre of forecasting than the medium-range models of Aardvark.

> Google has a local nowcast model that uses raw observations, in production, but that's a different genre of forecasting than the medium-range models of Aardvark.

It's very clear from the MetNet announcement blog[1] that they require HRRR or other NWP output at runtime.

[1]: https://research.google/blog/metnet-3-a-state-of-the-art-neu...

They train with ERA5 and observations.

Reply on news.ycombinator.com