"New ECMWF Model Versions: 50r1 and AIFS V2s"
Q1: What is the difference between AIFS Single and AIFS Ens control member?
Single is unperturbed, based on minimising an RMSE metric. AIFS-ENS Control is based on a different error (CRPS) minimization metric, and an unperturbed analysis, but has random "diffusion" perturbations applied during the run; it is therefore much less like a typical Control run, in the classical sense.
Q2: Precipitation has improved with this cycle because now convective precip is moving. There are still some unrealistic bullseye blobs; is it possible that they will now move?
Yes blobs may still appear, e.g. over Finland. That aspect should have been improved a bit in 50r1, but there is a change that will do more in 51r1.
And yes, the bullseye blobs may now move.
Q3. I loved the explanation for the difference between AIFS Single and AIFS ENS Control. It is difficult to be in a position where all these new models are published, and we struggle using all of this in our operational service. But we have to take a leap of faith on when to start using it in our operations. We are struggling to describe to our colleagues how to use it, when to use it, what the advantages of it are and when not to use it. Forecasters are just pushing products, we don't always have time to look at everything. Often we look at local model outputs and compare to IFS. The AIFS is just another (global) model. My question is, how do we get to learn it as forecasters. What's the main focus points we need to be aware of as forecasters.
A: Yes the main point is that all these models are very new. In addition you don't have the hindcast yet nor the maturity of IFS and experience of working with it. Currently, the main thing is to monitor and to learn how they perform. The temporal and horizontal resolution is low, and it will get better in the future.
Input from users would be good - so not all the forecasters have to learn individually (maybe ECMWF could organise a session on this).
AI models are quite good for 2m temperature, but not so great for 10m winds. For TCs they are good for the location, but not so great for winds.
Known AIFS model issues (and indeed known IFS model issues) are recorded and updated for users in the ECMWF Forecast User Portal here - see links in the top right.
Q: Do you expect that AIFS catches things earlier?
Sometimes the intensity of features (e.g. TCs) can be underestimated. Most of what it learns is from ERA5, and that uses a "low resolution" model (31km; whereas today's IFS runs at 9km).
Q: Can we expect more release of AIFS asyncronously than IFS. Will new release of AIFS come before IFS?
A: Yes, for example with 50r1 we had to release them together. The old AIFS was not coping well. This is something we still need to figure out. But we don't necessarily have to sync them. Let's see.
Q: Could you also take requests and feedback from the users. Now you have a new wave model; obviously from the moment people start to use it, the question of consistency will arise.
A: Of course user feedback influences our developments, and we also depend on it to some extent. We would all like higher temporal and spatial resolution.
Q: Regarding consistency among elements in the AIFS. When you're adding new elements in the AIFS, do you prefer to have consistency between them or to optimise each separately?
A: This is also an open science question. Currently we train AIFS-Single on RMSE for all the variables. We have a relatively simple cost function, so inconsistencies can arise. Indeed some have arisen. But at the same time the consistency achieved is usually quite high and quite reassuring. AIFS-ENS is trained in a different way, but inconsistencies can and have arisen there too.
Q: Is the IFS to AIFS nudging solution the answer to this or is ECMWF exploring other approaches to make AIFS and IFS more consistent?
A: We have introduced bounds on output values, to prevent negative precipitation, and to make convective and large scale precipitation consistent with the total precipitation. We are still working on future model configuration options, trying to decide upon the most expedient route, taking into account multiple different angles, including user needs, maintainability, computational tractability.
Q: Do you plan to make IFS to AIFS nudging model operational.
A: The decision has not yet been made. There are other hybrid approaches that we are exploring. For example where you look at differences between short-range forecasts and obs, and try to teach neural networks to learn model biases, and thereby to add other terms, to represent e.g. "missing" physics. At the moment the nudging approach looks much better in terms of scores.
One significant challenge is that the number of possible approaches is escalating. We have to manage this carefully.
Q: There are special cases with dust over Bulgaria, when IFS doesn't predict convection well, but for some reason AIFS does. In these cases dust influences the convective precipitaiton. I don't know if we have enough cases to say yes to one model, AIFS is better.
It might be worth looking at our CAMS forecast, and aerosols in that, though admittedly that may become too much information.
Users were asked to share those situations where dust appears to have been a key factor .
AIFS doesn't know anything about dust, but it can potentially learn behaviours indirectly.
Q: Is there now more advection of convective precipitation?
Some of the convective precip is now handed over to the large scale scheme, which will advect it. In the webinar on 50r1, there are some cases that were shown where you see the improvements, but the problem has not been completely solved.
Q: I am wondering how this will affect the west african cost? Is there anything that hints to the user that rainfall there will now be moving more (via advection).
Look for cases where there are strong winds over the coast. We haven't looked much at situations with light winds.
Q: Do the convective scheme change mean that 50r1 scatters precipitation over a wider area? Is the intensity is the same? Does precipitation with the same intensity expand to cover a bigger area?
Precipitation will cover a larger area. Overall intensities will be lower than previously, in some integrated sense (we are not creating extra rainfall). But of course inland (say) where in the previous cycle there may have been no rain now there will be some. So it becomes inevitable that the frequency of light precipitation/small precipitation totals goes up in cycle 50r1.
Q: Addition of 06/18UTC runs would be more useful if they had data beyond day 6.
This is somewhat constrained by ECMWF's computational resources.
Q: What is the difference between the number of people working on AI models versus the number working on physics-based models.
We have more people working on the physics-based models, but some people are working on both. And people can flip from one side to the other.
Q: What are the next big steps for AIFS?
Resolution improvements: time resolution first and then spatial resolution. And an ocean component in some form.
Q: What about improving convective precipitation in AIFS?
When you look at the extremes, it struggles. It is not predictable. The AIFS-ENS should not struggle, but most of the learning is on ERA5, which is at lower resolution. But this does not mean that we will not have something better in the future.
The new (ERA6) reanalysis will help; that has 14km resolution. It won't help with large scale aspects, but will bring in some higher resolution features. Although we augment ERA5 training with data from more recent 9km operational runs (10 years worth), it will be very helpful to have multiple decades of higher resolution data from ERA6.
Q: Will AIFS move to 9km resolution?
This is not planned for the next release of AIFS.
Q: CAT (Clear Air Turbulence parameters) have been quite well received, and it would be good to have them available in the AIFS.
Noted. To help with this we could learn not just from analyses but also from short range forecasts (which we already do for precipitation).