Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Overview

OpenIFS users can check their model installation with a short acceptance test on T21 resolution. The meteorological evaluation framework makes it possible also to assess the meteorological performance of OpenIFS based on two sets of case studies.

We chose two weather events which had been predicted originally with different skill. Several model experiments were carried out

CSS Stylesheet
.cell_nopadding {
    padding: 3px;
    border: 0px;
}

.table_noborder {
    border: 0px;
}

.vertical {
    height: 100%;
}

.vertical td:first-child {
    position: relative;
    width: 35px;
    padding: 0;
    border: 2px solid #cccccc;
}

.vertical_text {
    display: block;
    white-space: nowrap;
    -moz-transform: rotate(-90deg);
    -moz-transform-origin: center center;
    -webkit-transform: rotate(-90deg);
    -webkit-transform-origin: center center;
    -ms-transform: rotate(-90deg);
    -ms-transform-origin: center center;
    position: absolute;
    width:25px;
    color: #205081;
}

.table_line {
    padding: 0;
    height: 2px;
    border-left: 0px;
    border-right: 0px;
}

.table_line td:first-child {
    padding: 0;
    height: 2px;
    border-left: 0px;
    border-right: 0px;
}

.font_background {
    background-color: cyan;
}

Introduction

Meteorological evaluation of the OpenIFS outputs is demonstrated here on case studies. Two weather events have been chosen in order to show the model's capabilities on the one hand, and on the other hand, to provide reference cases for the users (to compare the results of their installed model version with the ones run at the ECMWF or to inter-compare the results of different model versions). Important aspects at selection of the cases were their geographical scope and their physical background, i.e., those storm events were preferred which had severe impact over Europe and were governed by large-scale dynamical forcings. Cases both with weak and good operational forecast skill were considered.

Panel
bgColorwhite
titleBGColor#dcf0f7
borderStyledotted
titleOn this page...

Table of Contents
indent20px

Case studies

Storm Xaver

On the 5 December 2013 a large and violent cyclonic storm hit the North Sea region and several adjacent countries. Problems were caused both by the high wind speeds and the related storm surge. The surge reached 6 metres in Hamburg for example and was the highest along the England east-coast for 60 years. In the aftermaths of the cyclone a blizzard hit Sweden. The storm system was named Xaver by Berlin's Free University; other names assigned elsewhere include Bodil, Sven and St. Nicholas (Hewson et al., 2014). T he cyclone developed around 00 UTC on 4 December northeast of Newfoundland and it was situated between converging northerly and southerly airstreams. Due to the westerly wind jet accelerated by the convergence, the cyclone moved to northeast and east, deepening explosively. It had an intense meso-vortex hanging back to west, which enhanced the strong wind (see Figure 1). The cyclone was presented in the operational forecasts 8-9 days before the event and the forecasts indicated the very strong wind gust 3-4 days in advance. (Although some strength overestimation over Germany as well as timing error in surface pressure were concluded.)

Anchorfigure1figure1 Image Removed

Image Removed

Image Removed

Image Removed

Figure 1: 24-hour maximum wind gust (m/s) on 5 December based on ECMWF operational IFS forecasts at 00 UTC on 3 and 5 December (left and middle, respectively; with white contours for the mean sea level pressure in hPa on 12 UTC on 5 December) and from the observations (right).

Storm Desmond

Storm Desmond caused severe flooding, travel disruption and a power outage across northern England, parts of Scotland and Ireland on 5 December 2015. Cumbria in northwestern part of England is one of the worst affected regions with more than 200 mm of rain in 24 hours recorded in that area. Storm Desmond broke the United Kingdom's 24-hour rainfall record, with 341.4 mm of rain falling in Honister Pass, Cumbria. On Saturday, 5 December, UK Met office issued a red warning of heavy rain for Cumbria. The cyclone also led to flooding in southern Norway.

Orographical enhancement of precipitation played a major role in the event and the operational model of the ECMWF picked well the highest rainfall amounts over the orographical barriers. However, the forecast underestimated the peak values of about 100 mm in 24 hours in Cumbria and overestimated the precipitation amount in lee of the hills (Figure 2).

Anchorfigure2figure2 Image Removed

Image Removed

Image Removed

Figure 2: 24-hour precipitation amount (mm) between 6 UTC on 5 December and 6 UTC on 6 December, based on ECMWF operational IFS forecast at 00 UTC on 5 December (left; with cyan contours for the mean sea level pressure in hPa at 12 UTC on 5 December) and observations (right).

Model experiments

Several experiments have been conducted with OpenIFS for both cases with the aim

to test the effect of starting date

and

, forecast length, initial condition as well as spatial resolution

to the forecast quality. The details of experiments are summarized in Table 1. Anchortable1table1Table 1: Settings of the experiments achieved for Storm Xaver and Storm Desmond.Experiment IDInitial conditionResolutionStarting dateTime stepOutput frequency
Xaver
1.ERA-InterimT255L911 Dec 20132700 s3h2.ERA_InterimT639L137900 s3h3.ERA5T255L912700 s3h4.ERA5T639L137900 s3hline
Desmond
1.grygERA-InterimT255L91

1 Dec 2015; 2 Dec 2015;
3 Dec 2015; 4 Dec 2015; 5 Dec 2015

2700 s3h2.gs22ERA-InterimT639L137

3 Dec 2015; 4 Dec 2015  

900 s3h3.gs23ERA-InterimT1279L1373 Dec 2015; 4 Dec 2015600 s3h4.gs0cERA5T255L91

3 Dec 2015; 4 Dec 2015

2700 s3h5.gs04ERA5T639L137

3 Dec 2015; 4 Dec 2015

900 s3h

!! The input data and the namelists needed to run the experiments can be downloaded from the ECMWF FTP server: download.ecmwf.int/openifs/evalution. !!

The files are packed in .tgz files and structured into directories named after the case studies (i.e., Xaver_201312, Desmond_201512) and subdirectories indicating the main experiment characteristics (e.g., T255L91_ERA5). The archive files were prepared by starting dates (e.g., gs0c_2015120300.tgz). Typical content of a .tgz file is as follows:

Panel
borderColor#cccccc
borderWidth1
borderStylesolid
titleSample directory list of the archive files

                    Size File name                                         Description

            0 2015120300/                               : directory for a given starting date
            0 2015120300/ecmwf/                         : subdirectory containing the namelists and some outputs
         4750 2015120300/ecmwf/namelistfc               : namelist with detailed experiment setup
      3983964 2015120300/ecmwf/NODE.001_01.model.1      : text output (log) file including all the important information about the model run
        26563 2015120300/ecmwf/ifs.stat.model.1         : information about model steps (useful for debugging)
         3161 2015120300/ecmwf/wam_namelist             : namelist of the coupled wave model
         3161 2015120300/ecmwf/wam_namelist_coupled_000 : namelist of the coupled wave model
      9763008 2015120300/ICMCLgs0cINIT                  : input file containing surface and soil information (albedo, soil temperature etc.)
      7311120 2015120300/ICMGGgs0cINIT                  : input file containing gridpoint surface initial data
     36695160 2015120300/ICMSHgs0cINIT                  : input file containing initial data for the prognostic variables in spectral representation
    106044120 2015120300/ICMGGgs0cINIUA                 : input file containing initial data for the prognostic variables in gridpoint representation
     54997789 2015120300/wam_grid_tables                : model grid and tables for the wave model
     13000184 2015120300/wam_subgrid_0                  : information for model advection, including sub-grid parametrisation for the wave model
     26709432 2015120300/wam_subgrid_1                  : information for model advection, including sub-grid parametrisation for the wave model
     26709416 2015120300/wam_subgrid_2                  : information for model advection, including sub-grid parametrisation for the wave model
        64560 2015120300/cdwavein                       : initial value of drag coefficient for the wave model
      7943760 2015120300/specwavein                     : initial wave spectra for the wave model
        64560 2015120300/uwavein                        : initial value of wind speed for the wave model
      2349600 2015120300/sfcwindin                      : initial value of 10-meter horizontal wind components and sea ice fraction for the wave model

To run OpenIFS, the files highlighted in green in the box above are needed, i.e., the initial conditions for the atmospheric model (files with ICM) and the namelist (namelistfc). The namelist controls the necessary settings (e.g., time step, experiment ID) as well as the post-processing. The most important namelist elements are listed below with their explanation:

Panel
borderColor#cccccc
borderWidth1
borderStylesolid
titleSample namelist

&NAMDYN                  ! Name of the namelist group
TSTEP=2700.0,            ! Timestep in seconds
/                        ! End of the namelist group

&NAMFPG
NFPLEV=91,               ! Number of vertical levels
NFPMAX=255,              ! Spectral truncation
/

&NAMCT0
CNMEXP="gs0c",           ! Experiment ID
/

&NAMFPC
! Model level outputs: number of fields (NFP3DFS), GRIB field codes (MFP3DFS) and model levels (NRFP3S)

NFP3DFS=5,
MFP3DFS(:)=130,135,138,155,133,
NRFP3S(:)=1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,\
          28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,\
          52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,\
          76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,

! Pressure level outputs: number of fields (NFP3DFP), GRIB field codes (MFP3DFP) and pressure levels in Pascals (RFP3P)

NFP3DFP=7,
MFP3DFP(:)=129,130,135, 138,155 ,157,133,
RFP3P(:)=100000.0,92500.0,85000.0,70000.0,50000.0,40000.0,30000.0,25000.0,20000.0,\
         15000.0,10000.0,7000.0,5000.0,3000.0,2000.0,1000.0,700.0,500.0,300.0,200.0,100.0,

! Saving spectral orography (geopotential), surface pressure (logarithm of surface pressure) needed to post-processing
NFP2DF=2,
MFP2DF(:)=129,152,
! Physics output: number of fields (NFPPHY) and GRIB field codes (MFPPHY)

NFPPHY=89,
MFPPHY(:)=31,32,33,34,35,36,37,38,39,40,41,42,44,45,49,50,57,58,59,78,79,129,136,\
          137,139,141,142,143,144,145,146,147,148,151,159,164,165,166,167,168,169,\
          170,172,175,176,177,178,179,180,181,182,183,186,187,188,189,195,196,197,\
          198,201,202,205,206,208,209,210,211,235,236,238,243,244,245,229,230,231,\
          232,213,212,8,9,228089,228090,228001,260121,260123,228129,228130,
/

In the evaluation, we would like to investigate the following variables:

  • 2-meter temperature: its GRIB code number is 167;
  • precipitation: it is composed from large-scale and convective precipitation with code numbers 142 and 143, respectively;
  • mean sea level pressure: its code number is 151;
  • 10-meter wind gust: its code number is 49;
  • temperature at 850 hPa level: its code number is 130;
  • relative humidity at 700 hPa level: its code number is 157;
  • geopotential at 500 hPa level: its code number is 129;
  • u and v wind components at 250 and 100 hPa.

HTML
<p>The listed variables have to be included in the namelist among the post-processing variables (see the code numbers and levels highlighted with <b>bold</b> characters in the box above). Instead of the wind components at given pressure level, the direct model output contains vorticity and divergence (with code number 138 and 155; see the highlight in <b><font color=red>red</font></b> above). To obtain the horizontal wind components, an external post-processing is needed, which calculates <i>u</i> and <i>v</i> from the vorticity and divergence (see later). More information about the namelist settings and GRIB field codes can be found in the <b><a href="https://software.ecmwf.int/wiki/display/OIFS/How-to+articles" target="_blank">how-to articles</a></b>: <a href="https://software.ecmwf.int/wiki/display/OIFS/How+to+control+OpenIFS+output" target="_blank">How to control OpenIFS output</a>.</p>
HTML
<p><b><font color=red>!!</font></b> To run the model, the paths of the input data and the namelist have to be set in the job.  ..... <a href="https://software.ecmwf.int/wiki/display/OIFS/5.6+Acceptance+testing+OpenIFS+after+installation" target="_blank">Acceptance testing OpenIFS after installation</a>.</p>

Preparation of data for visualization

Post-processing of model outputs

  • t2_${day}.grib for 2-meter temperature,
  • p_${day}.grib for precipitation,
  • mslp_${day}.grib for mean sea level pressure,
  • gust_${day}.grib for 10-meter wind gust,
  • t850_${day}.grib for temperature at 850 hPa,
  • q700_${day}.grib for relative humidity at 700 hPa,
  • z500_${day}.grib for geopotential at 500 hPa,
  • u250_${day}.grib for horizontal wind components at 250 hPa,
  • u100_${day}.grib for horizontal wind components at 100 hPa,

where day is the given date in format of yyyymmdd (e.g., 20151203). All the files should contain data for 8 timesteps per day (i.e., in every 3 hours).

Note

Please note the lowercase letters in the filenames.

The 2-meter temperature, the precipitation, the mean sea level pressure and the wind gust are expected in gridpoint representation, so will be taken from the ICMGG files. To prepare the needed input files for the Metview macros, the next operations are needed on the raw ICMGG outputs:

Panel

grib_copy -w marsParam=167 ICMGG${expID}+00${step} t2_${day}${step}.grib    #to get the 2-meter temperature
grib_copy -w marsParam=151 ICMGG${expID}+00${step} mslp_${day}${step}.grib  #to get the mean sea level pressure
grib_copy -w marsParam=49 ICMGG${expID}+00${step} gust_${day}${step}.grib   #to get the 10-meter wind gust

where expID is the 4-digit experiment ID and step is the post-processing step (every 3 hours). For precipitation, both the convective and large-scale precipitation components have to be in the same file:

Panel

grib_copy -w marsParam=142,marsParam=143 ICMGG${expID}+00${step} p_${day}${step}.grib

The pressure level data are required in spectral representation, so they will be taken from ICMSH files. To prepare the needed input files for the Metview macros, the next operations are needed on the raw ICMSH outputs:

Panel

grib_copy -w marsParam=130,level=850 ICMSH${expID}+00${step} t850_${day}${step}.grib  #to get the temperature at 850 hPa
grib_copy -w marsParam=157,level=700 ICMSH${expID}+00${step} q700_${day}${step}.grib  #to get the relative humidity at 700 hPa
grib_copy -w marsParam=
129,level=500 ICMSH${expID}+00${step} z500_${day}${step}.grib  #to get the geopotential at 500 hPa

HTML
For wind, the files should include the <i>u</i> and <i>v</i> wind components. To obtain wind components from the vorticity and divergence, we will use the <font style="font-family:monospace;">dv2uvl</font> command of CDO (Climate Data Operators) software (more information about the possibilities in CDO can be found in the <b><a href="https://software.ecmwf.int/wiki/display/OIFS/How-to+articles" target="_blank">how-to articles</a></b>: <a href="https://software.ecmwf.int/wiki/display/OIFS/How+to+convert+GRIB+to+netCDF" target="_blank">How to convert GRIB to netCDF</a>):
Panel

#to filter the vorticity and divergence at 250 hPa from the ICMSH file
grib_copy -w marsParam=158,marsParam=155,level=250 ICMSH${expID}+00${step} rotdiv250_${day}${step}.grib

#to get the wind components from the vorticity and divergence at 250 hPa
cdo dv2uvl rotdiv250_${day}${step}.grib u250_${day}${step}.grib

#to filter the vorticity and divergence at 100 hPa from the ICMSH file
grib_copy -w marsParam=158,marsParam=155,level=100 ICMSH${expID}+00${step} rotdiv100_${day}${step}.grib

# to get the wind components from the vorticity and divergence at 100 hPa
cdo
dv2uvl rotdiv100_${day}${step}.grib u100_${day}${step}.grib

The size of the resulted files varies by the spatial resolution and the representation of the data. For instance, the file size at T255L91 resolution is 10 MB and 8 MB per variables for gridpoint and spectral fields, respectively, whereas these values increases to 35 MB and 26 MB at T639L137, to 233 MB and 179 MB at T1279L137.

Preparation of reference data

As reference data, we will apply ECMWF re-analyses. Both ERA-Interim and ERA5 datasets are available for the users and can be downloaded from the ECMWF MARS (Meteorological Archival and Retrieval System) system. Re-analyses are created by optimal combination of available observational information and short-range numerical predictions using data assimilation techniques and provide the most comprehensive description of the past and current states of the 3-dimensional atmosphere or the Earth system.

on the forecast quality. The model outputs are visualized and evaluated using Metview.

After introduction of the two cases, this section guides the user step by step through running the selected experiments, post-processing the model outputs, downloading the reference data and visualising the model outputs with Metview. A catalogue from the prepared figures is also included. The input data and the namelists needed for the model runs, the scripts for the MARS retrieves of the re-analyses, the Metview macros for visualization and the output figures are available for download on the ECMWF download server.


Section


Column
width50px



Column

Page Tree
root@self
spacesOIFS
searchBoxtrue





Excerpt Include
Credits
Credits
nopaneltrue






Panel
titleOpenIFS User Guide ...

Children Display
depth1
pageOpenIFS 43r3 User Guide

ERA-Interim dataset (Berrisford et al., 2011) was prepared on 79 km horizontal resolution with 60 vertical levels starting from 1979. Analysis fields were constructed in every 6 hours using variety of observations (conventional measurements, remote sensing data, air craft measurements etc.), the 4D-Var data assimilation technique and the IFS model version which was operational in 2009 (cycle 31r2). The forecasts initialized from the analysis produced 3 hourly outputs up to 24 hours. 

HTML
<p><b>ERA5</b> (<a href="#hersbach">Hersbach and Dee</a>, 2016) is being constructed on higher, 32 km horizontal resolution with 137 vertical levels from 1950. Analysis fields are is being prepared hourly with inclusion of newly reprocessed observational data, using the 4D-Var data assimilation technique and the IFS cycle 42r1 model version. ERA5 forecasts initialized from the hourly analyses produce hourly outputs up to 18 hours and give an estimation of forecast uncertainty. There is an important difference between ERA-Interim and ERA5 in handling of the accumulated parameters: in ERA5 the accumulation is calculated from the previous post-processing step (i.e., along one hour), while in ERA-Interim it is from the beginning of the forecast &ndash; this feature will have relevance in evaluation of the precipitation amount and wind gust. (More information about the characteristics of ERA-Interim and ERA5 can be found in the <b><a href="https://software.ecmwf.int/wiki/display/CKB/Copernicus+Knowledge+Base" target="_blank">Copernicus Knowledge Base</a></b>: <a href="https://software.ecmwf.int/wiki/pages/viewpage.action?pageId=74764925" target="_blank">What are the changes from ERA-Interim to ERA5?</a>)</p>
  • ${dataset}_t2_${period}.grib for 2-meter temperature,
  • ${dataset}_p_${period}.grib for total precipitation,
  • ${dataset}_mslp_${period}.grib for mean sea level pressure,
  • ${dataset}_gust_${period}.grib for 10-meter wind gust,
  • ${dataset}_t850_${period}.grib for temperature at 850 hPa,
  • ${dataset}_q700_${period}.grib for relative humidity at 700 hPa,
  • ${dataset}_z500_${period}.grib for geopotential at 500 hPa,
  • ${dataset}_u250_${period}.grib for horizontal wind components at 250 hPa,
  • ${dataset}_u100_${period}.grib for horizontal wind components at 100 hPa,

where dataset is a 2-digit identifier of the re-analysis data, ei for ERA-Interim and ea for ERA5; period is the investigated time period in format of yyyymmdd-yyyymmdd (e.g., 20151201-20151206 for Desmond).

Note

Please note again the lowercase letters in the filenames. Furthermore, the re-analysis data should not be split by day, because data for the whole period will be handled together by the Metview macros.

The 2-meter temperature, the precipitation, the mean sea level pressure and the wind gust are expected in gridpoint representation, while the pressure level data are required in spectral representation. Total precipitation and wind gust as accumulated parameters derive from forecasts, all the other variables are real analyses. Consequently, the daily quantities for precipitation and wind gust are composed of 8 and 24 timesteps from ERA-Interim and ERA5, respectively, the other variables have 4 and 8 timesteps (recall that output frequency of the forecast experiment is 3 hours). Besides the two (large-scale and convective) precipitation components, total precipitation is also available for direct retrieve both in ERA-Interim and ERA5, with GRIB code 228.

HTML
<p>
To download the necessary data from MARS, the following steps have to be accomplished:
<ol>
   <li>To have access to the ECMWF public datasets, you will need to have an account on ECMWF web site: <a href="https://apps.ecmwf.int/registration/" target="_blank">https://apps.ecmwf.int/registration/</a>.
   <li>To retrieve data from MARS, you will need to download and install an ECMWF key. This page shows that step by step: <a href="https://software.ecmwf.int/wiki/display/WEBAPI/Access+ECMWF+Public+Datasets" target="_blank">Access ECMWF Public Datasets</a>.
   <li>Having your key, you can run the <a href="https://software.ecmwf.int/stash/projects/OIFS/repos/oifs40r1/browse/casestudies/mars/scr_download_re-analysis?at=evaluation" target="_blank"><font style="font-family:monospace;">scr_download_re-analysis</font></a> shell script available in the <a href="https://software.ecmwf.int/stash/projects/OIFS/repos/oifs40r1/browse" target="_blank">OpenIFS repository (for cycle 40r1)</a> and using <font style="font-family:monospace;">getmars</font> for retrieve.
</ol>
</p>

The re-analysis source (i.e., ERA-Interim or ERA5), the surface and pressure level variables to be retrieved, the period of the data and the output directory have to/can be specified for the scr_download_re-analysis script. Calling it with -h option, it gives a detailed help with some examples at the end (or calling it without any option, it also gives short instructions to its configuration):

Code Block
languagetext
digs@laerad 995: ./scr_download_re-analysis -h
 ----------------------------------------------------------------------
        This script downloads surface and pressure level ERA-Interim or ERA5 re-analysis data for a given time range from MARS.
        Usage:
        -c[class],-s[surface_variables],-p[plevel_variables],-f[firstdate],-l[lastdate],-o[output_directory]
        -h/-help

        Examples:
       ./scr_download_re-analysis -cei -s"t2 p mslp gust" -p"t850 q700 z500 u250 u100" -f20151203 -l20151205 -o"../reference"
       ./scr_download_re-analysis -cea -sall -p"t850 q700 z500 u250 u100" -f20151203 -l20151205 -o"/home/rd/digs/metview/paper_OIFS/input/reference"
       ./scr_download_re-analysis -ce5 -s" " -p"t850" -f20151203 -o"/home/rd/digs/metview/paper_OIFS/input/reference"
 ----------------------------------------------------------------------
Note

Please take into account that the script is able to retrieve only the variables listed above. For further parameters the program has to be modified manually.

Furthermore, please note the all option which can be used with -s and -p switches. That makes possible not to list all the necessary variables in the command line, but it takes automatically all the surface and/or pressure level variables discussed above.

Metview macros

- where they are, how to set them up .. etc

Catalogue

References

AnchorberrisfordberrisfordBerrisford, P., Dee, D.P., Poli, P., Brugge, R., Fielding, K., Fuentes, M., Kållberg, P.W., Kobayashi, S., Uppala, S., Simmons, A., 2011: The ERA-Interim archive Version 2.0. ECMWF ERA Report Series, 27 p. [PDF]
HTML
<p><a name="hersbach"></a>Hersbach, H., Dee, D.P., 2016: <a href="https://www.ecmwf.int/en/newsletter/147/news/era5-reanalysis-production" target="_blank">ERA5 reanalysis is in production.</a> <em>ECMWF Newsletter 147,</em> p. 7.</p>
AnchorhewsonhewsonHewson, T., Magnusson, L., Breivik, O., Prates, F., Tsonevsky, I., de Vries, H.J.W., 2014: Windstorms in northwest Europe in late 2013. ECMWF Newsletter 139, 22–28. [PDF] Excerpt IncludeCreditsCreditsnopaneltrue