In addition to showcasing global RPSSs on the AI Weather Quest website, regional forecast evaluation is being regularly performed to inform AI model developers of locations of forecast deficiency. The following section is divided into individual competitive periods, i.e. SON 2025 and DJF 2025/2026. For each competitive period, the same analysis has been performed. Please note, that these webpages are an area of dynamic forecast evaluation and will regularly change throughout the Quest.
Format of individual periodic pages
The following outlines the current structure of regional forecast analysis webpages:
- Introduction: The introduction states the focused competitive period. More importantly, it highlights the selection of forecast initialisations used to compute model evaluation.
- Regional skill score files: These excel spreadsheets contain all the regional skill scores for every submission to the AI Weather Quest.
- Tables showing regional scores for the teams with the top 10 global, period-aggregated, variable-averaged RPSSs. These tables focus on regional, variable-averaged scores for each of the two forecast windows (days 19 to 25 and 26 to 32).
- Figures showing aggregated RPSSs for the best-performing model from the top 10 teams. For each variable and forecast window, figures show global maps for aggregated-RPSSs. Please note, that during early stages of the competitive period, only a few forecast initialisations have been used to compute grid-point values.