Oh they absolutely do track their predictions and how the different models perform. That’s how they keep improving.

This is a lay-person overview which cites some of the in-depth studies: https://ourworldindata.org/weather-forecasts