In addition to displaying global RPSSs on the AI Weather Quest website, we perform automated regional forecast evaluations to provide model developers with insights into areas where forecasts may be underperforming. The regional forecast evaluation webpage should update on day 37 of the forecast workflow, once the AI Weather Quest leaderboards have been published.
The following sections are organised by competitive period (e.g., SON 2025 and DJF 2025/2026). The same analysis is applied for each period. Please note, that these webpages represent a dynamic, continuously updated forecast evaluation. Content will change as new data and forecast initialisations become available.
Each page begins with an introduction that specifies the competitive period under review. It also highlights the forecast initializations used to compute the model evaluation.
Excel spreadsheets provide all regional skill scores for every submission to the AI Weather Quest, enabling detailed comparison of performance across regions.
Tables summarise regional, variable-averaged RPSSs for the teams with the top 10 global, period-aggregated RPSSs. Scores are presented for two forecast windows: days 19–25 and days 26–32.
For the highest-performing model from the top 10 teams, figures show global maps of aggregated RPSSs for each variable and forecast window. Note that during the early stages of a competitive period, only a limited number of forecast initializations may be available to compute grid-point values.
The following zonal regions are used for large-scale evaluation of forecast performance:
| Region Name | Latitude Range | Colour (Map) |
|---|---|---|
| Tropics | 30°N – 30°S | Slate Gray |
| Northern Hemisphere Extratropics (NH Ext.) | 60°N – 30°N | Medium Aquamarine |
| Southern Hemisphere Extratropics (SH Ext.) | 30°S – 60°S | Steel Blue |
| Northern Polar Region (NH Pol.) | 90°N – 60°N | Blue Violet |
| Southern Polar Region (SH Pol.) | 60°S – 90°S | Purple |
For more localized assessments, continental-scale regions are defined as follows:
| Region Name | Northern Boundary | Southern Boundary | Western Boundary | Eastern Boundary | Colour (Map) |
|---|---|---|---|---|---|
| North America | 72°N | 15°N | 170°W | 50°W | Charcoal Gray |
| South America | 15°N | 60°S | 85°W | 35°W | Medium Aquamarine |
| Europe | 72°N | 35°N | 25°W | 40°E | Steel Blue |
| Africa | 35°N | 35°S | 20°W | 55°E | Dark Blue |
| Asia | 80°N | 5°N | 40°E | 180°E | Blue Violet |
| Oceania | 5°N | 50°S | 90°E | 180°E | Purple |
Figures 1 and 2: Zonal and continental areas used to evaluate forecast skill.