.cell_nopadding {
    padding: 3px;
    border: 0px;
}

.cell_leftmargin {
    padding-left: 30px;
 }

.table_noborder {
    border: 0px;
}

.vertical {
    height: 100%;
}

.vertical td:first-child {
    position: relative;
    width: 35px;
    padding: 0;
    border: 2px solid #ddd;
}

.vertical_text {
    display: block;
    white-space: nowrap;
    -moz-transform: rotate(-90deg);
    -moz-transform-origin: center center;
    -webkit-transform: rotate(-90deg);
    -webkit-transform-origin: center center;
    -ms-transform: rotate(-90deg);
    -ms-transform-origin: center center;
    position: absolute;
    width:25px;
    color: #205081;
}

.table_line {
    padding: 0;
    height: 2px;
    border-left: 0px;
    border-right: 0px;
}

.table_line td:first-child {
    padding: 0;
    height: 2px;
    border-left: 0px;
    border-right: 0px;
}

.font_background_cyan {
    background-color: cyan;
}

.font_background_yellow {
    padding: 2px;
    background-color: #ffffb3;
}

.font_background_grey {
    padding: 2px;
    background-color: #dddddd;
}

.font_code_black {
    color: #000000;
    font-family: Monospace;
}

.li_withspace {
    margin-bottom: 10px;
}

Image Removed

Storm Desmond

Storm Desmond caused severe flooding, travel disruption and a power outage across northern England, parts of Scotland and Ireland on 5 December 2015. Cumbria in northwestern part of England is one of the worst affected regions with more than 200 mm of rain in 24 hours recorded in that area. Storm Desmond broke the United Kingdom's 24-hour rainfall record, with 341.4 mm of rain falling in Honister Pass, Cumbria. On Saturday, 5 December, UK Met office issued a red warning of heavy rain for Cumbria. The cyclone also led to flooding in southern Norway.

Orographical enhancement of the precipitation played the major role in the event and the operational model of ECMWF picked well the highest rainfall amounts over the orographical barriers. However, the forecast underestimated the peak values of about 100 mm in 24 hours in Cumbria and overestimated the precipitation amount in lee of the hills (Figure 2).

Image Removed

Model experiments

1 Dec, 2 Dec, 3 Dec, 4 Dec, 5 Dec 2015

The files are packed in .tar.gz files and structured into directories named after the case studies (i.e., Xaver_201312, Desmond_201512) and subdirectories indicating the main experiment characteristics (e.g., T255L91_ERA5). Each archive file contains the data for a given starting date (e.g., gs0c_2015120300.tar.gz). Typical content of a .tar.gz file is as follows:

File name                                       Description                                                                                                                                                                                   Size

The namelist file highlighted in green in the box above controls the necessary settings (e.g., time step, experiment ID) as well as the post-processing. The most important namelist elements are listed below with their explanation:

In the evaluation, we would like to investigate the following variables:

• 2-meter temperature: its GRIB code number is 167;
• precipitation: it is composed from large-scale and convective precipitation with code numbers 142 and 143, respectively;
• mean sea level pressure: its code number is 151;
• 10-meter wind gust: its code number is 49;
• temperature at 850 hPa level: its code number is 130;
• relative humidity at 700 hPa level: its code number is 157;
• geopotential at 500 hPa level: its code number is 129;

• u and v wind components at 250 and 100 hPa with code numbers 131 and 132, respectively.

<p>The listed variables have to be included in the namelist among the post-processing variables (see the code numbers and levels highlighted with <b>bold</b> characters in the box above). More information about the namelist settings and GRIB field codes can be found in the <b><a href="https://software.ecmwf.int/wiki/display/OIFS/How-to+articles" target="_blank">OpenIFS how-to articles</a></b>: <a href="https://software.ecmwf.int/wiki/display/OIFS/How+to+control+OpenIFS+output" target="_blank">How to control OpenIFS output</a>.</p>
<p><b><font color=red>!!</font></b> To run the model, the paths of the input data and the namelist have to be set in the job.  ..... <a href="https://software.ecmwf.int/wiki/display/OIFS/5.6+Acceptance+testing+OpenIFS+after+installation" target="_blank">Acceptance testing OpenIFS after installation</a>.</p>

Preparation of data for visualization

After the job run is completed, the outputs are split into 2 files (located in the working directory): ICMGG* files are for the gridpoint fields and ICMSH* files are for the spectral ones. The two files should include all the necessary variables set in the namelist. However, before visualisation of the results, some steps are still needed.

Post-processing of model outputs

The Metview macros prepared for visualisation of experiment results desire the meteorological variables in GRIB files separated by variables and days with the following file names:

• t2_${day}.grib for 2-meter temperature,
• p_${day}.grib for precipitation,
• mslp_${day}.grib for mean sea level pressure,
• gust_${day}.grib for 10-meter wind gust,
• t850_${day}.grib for temperature at 850 hPa,
• q700_${day}.grib for relative humidity at 700 hPa,
• z500_${day}.grib for geopotential at 500 hPa,
• u250_${day}.grib for horizontal wind components at 250 hPa,
• u100_${day}.grib for horizontal wind components at 100 hPa,

where day is the given date in format of yyyymmdd (e.g., 20151203). All the files should contain data for 8 timesteps per day (i.e., in every 3 hours).

The 2-meter temperature, the precipitation, the mean sea level pressure and the wind gust are expected in gridpoint representation. So they will be prepared from the raw ICMGG* outputs with the next operations:

where expID is the 4-digit experiment ID and step is the post-processing step (every 3 hours). For precipitation, both the convective and large-scale precipitation components have to be in the same file:

The pressure level data are required in spectral representation. So they will be prepared from the raw ICMSH* outputs with the next operations:

For wind, both the u and v components have to be in the same file:

The size of the resulted files varies by the spatial resolution and the representation of the data. For instance, the file size at T255L91 resolution is 10 MB and 8 MB per variables for gridpoint and spectral fields, respectively, whereas these values increases to 35 MB and 26 MB at T639L137, to 233 MB and 179 MB at T1279L137.

Preparation of reference data

As reference data, we will apply the ECMWF re-analyses. Both ERA-Interim and ERA5 datasets are available for the users and can be downloaded from the ECMWF MARS (Meteorological Archival and Retrieval System) system. (Please note that the figures above are based on station observations which are however not publicly accessible.) Re-analyses are created by optimal combination of available observational information and short-range numerical weather predictions using data assimilation techniques. They provide the most comprehensive description of the past and current states of the 3-dimensional atmosphere or the Earth system.

ERA-Interim dataset (Berrisford et al., 2011) was prepared on 79 km horizontal resolution with 60 vertical levels starting from 1979. Analysis fields were constructed in every 6 hours using variety of observations (conventional measurements, remote sensing data, air craft measurements etc.), the 4D-Var data assimilation technique and the IFS model version which was operational in 2009 (cycle 31r2). The forecasts initialized from the analysis produced 3 hourly outputs up to 24 hours. 

<p><b>ERA5</b> (<a href="#hersbach">Hersbach and Dee</a>, 2016) is being constructed on higher, 32 km horizontal resolution with 137 vertical levels from 1950. Analysis fields are being prepared hourly with inclusion of newly reprocessed observational data, using the 4D-Var data assimilation technique and the IFS cycle 42r1 model version. ERA5 forecasts initialized from the hourly analyses produce hourly outputs up to 18 hours and give an estimation of forecast uncertainty. There is an important difference between ERA-Interim and ERA5 in handling of the accumulated parameters: in ERA5 the accumulation is calculated from the previous post-processing step (i.e., along one hour), while in ERA-Interim it is from the beginning of the forecast &ndash; this feature will have relevance in evaluation of the precipitation amount and wind gust. (More information about the characteristics of ERA-Interim and ERA5 can be found in the <b><a href="https://software.ecmwf.int/wiki/display/CKB/Copernicus+Knowledge+Base" target="_blank">Copernicus Knowledge Base</a></b>: <a href="https://software.ecmwf.int/wiki/pages/viewpage.action?pageId=74764925" target="_blank">What are the changes from ERA-Interim to ERA5?</a>)</p>

The Metview macros prepared for visualisation of re-analysis data desire the meteorological variables in GRIB files separated by variables for a time period with the following names:

• ${dataset}_t2_${period}.grib for 2-meter temperature,
• ${dataset}_p_${period}.grib for total precipitation,
• ${dataset}_mslp_${period}.grib for mean sea level pressure,
• ${dataset}_gust_${period}.grib for 10-meter wind gust,
• ${dataset}_t850_${period}.grib for temperature at 850 hPa,
• ${dataset}_q700_${period}.grib for relative humidity at 700 hPa,
• ${dataset}_z500_${period}.grib for geopotential at 500 hPa,
• ${dataset}_u250_${period}.grib for horizontal wind components at 250 hPa,
• ${dataset}_u100_${period}.grib for horizontal wind components at 100 hPa,

where dataset is a 2-digit identifier of the re-analysis data, ei for ERA-Interim and eafor ERA5; period is the investigated time period in format of yyyymmdd-yyyymmdd (e.g., 20151201-20151206 for Desmond).

The 2-meter temperature, the precipitation, the mean sea level pressure and the wind gust are expected in gridpoint representation, while the pressure level data are required in spectral representation. Total precipitation and wind gust as accumulated parameters derive from forecasts, all the other variables are real analyses. Consequently, the daily quantities for precipitation and wind gust are composed of 8 and 24 timesteps from ERA-Interim and ERA5, respectively, the other variables have 4 and 8 timesteps (recall that output frequency of the forecast experiment is 3 hours). Besides the two (large-scale and convective) precipitation components, total precipitation is also available for direct retrieve both in ERA-Interim and ERA5, with GRIB code 228.

<p>
To download the necessary data from MARS, the following steps have to be accomplished:
<ol>
   <li class="li_withspace">To have access to the ECMWF public datasets, an account is needed to the ECMWF web site: <a href="https://apps.ecmwf.int/registration/" target="_blank">https://apps.ecmwf.int/registration/</a>.
   <li class="li_withspace">To retrieve data from MARS, an ECMWF key is needed to be downloaded and installed. This page shows that step by step: <a href="https://software.ecmwf.int/wiki/display/WEBAPI/Access+ECMWF+Public+Datasets" target="_blank">Access ECMWF Public Datasets</a>.
   <li class="li_withspace">Having the key, the <a href="https://software.ecmwf.int/stash/projects/OIFS/repos/oifs40r1/browse/casestudies/mars/scr_download_re-analysis?at=evaluation" target="_blank"><span class="font_code_black">scr_download_re-analysis</span></a> shell script has to be run. It is available in the <a href="https://software.ecmwf.int/stash/projects/OIFS/repos/oifs40r1/browse" target="_blank">OpenIFS repository (for cycle 40r1)</a> and using <span class="font_code_black">getmars</span> for retrieve.
</ol>
</p>

The re-analysis source (i.e., ERA-Interim or ERA5), the surface and pressure level variables to be retrieved, the period of the data and the output directory have to/can be specified for the scr_download_re-analysis script. Calling it with -h option, it gives a detailed help with some examples at the end (but calling it without any option, it also gives a short instruction to its configuration):

% ./scr_download_re-analysis -h
 ----------------------------------------------------------------------
        This script downloads surface and pressure level ERA-Interim or ERA5 re-analysis data for a given time range from MARS.
        Usage:
        -c[class],-s[surface_variables],-p[plevel_variables],-f[firstdate],-l[lastdate],-o[output_directory]
        -h/-help

        Examples:
       ./scr_download_re-analysis -cei -s"t2 p mslp gust" -p"t850 q700 z500 u250 u100" -f20151203 -l20151205 -o"../reference"
       ./scr_download_re-analysis -cea -sall -p"t850 q700 z500 u250 u100" -f20151203 -l20151205 -o"/home/rd/digs/metview/paper_OIFS/input/reference"
       ./scr_download_re-analysis -ce5 -s" " -p"t850" -f20151203 -o"/home/rd/digs/metview/paper_OIFS/input/reference"
 ----------------------------------------------------------------------

The retrieved ERA-Interim fields occupy approximately 54 MB, while ERA5 fields take 700 MB for the case Desmond (i.e., for 1–6 December 2015).

Visualization with Metview

The visualization package contains the following folders and file:

Using the Metview macros

plot_raw_IC.mv         : Metview macro to visualize the raw initial conditions for 2 experiments and the difference between them
plot_forecastrun.mv    : Metview macro to visualize the results of forecast experiments
plot_ERAI_ERA5.mv      : Metview macro to visualize the ERA-Interim or ERA5 data

raw_IC_dialog          : Metview dialogue box (in macro language) to plot_raw_IC.mv
forecastrun_dialog     : Metview dialogue box (in macro language) to plot_forecastrun.mv
ERAI_ERA5_dialog       : Metview dialogue box (in macro language) to plot_ERAI_ERA5.mv

help_plot_raw_IC       : help file to plot_raw_IC.mv
help_plot_forecastrun  : help file to plot_forecastrun.mv
help_plot_ERAI_ERA5    : help file to plot_ERAI_ERA5.mv

scr_run_macros         : shell script to execute the Metview macros


The visualisation can be done by the Metview macros (*.mv files) in the ways: (1) interactively using a dialogue box or (2) in batch mode.

(1) Interactive dialogue box

With right click on the macro and then selecting the Execute option from the menu, the settings can be seen in a dialogue box:

surface parameters in raw_IC_dialog: 3 variables are available for visualisation, soil level temperature 2, surface pressure, (model) orography;

model level parameters in raw_IC_dialog: 4 variables are available for visualisation, temperature, wind, specific humidity, cloud cover;

model levels for model level variables: from 1 (uppest) to 91 (lowest);

surface parameters in forecastrun_dialog and ERAI_ERA5_dialog: 4 variables are available, 2-meter temperature, mean sea level pressure, precipitation, 10-meter wind gust;

pressure level parameters in forecastrun_dialog and ERAI_ERA5_dialog: 5 variables are available, temperature at 850 hPa, geopotential at 500 hPa, wind at 250 and 100 hPa, relative humidity at 700 hPa;

pressure levels for pressure level variables: 850, 700, 500, 250, 100 hPa;

Multiple variables (both surface and model/pressure level ones) can be selected at the same time. In case of choosing any model or pressure level parameters, selecting also (at least) one model or pressure level should not be forgotten (multiple options are possible also here).

(2) Batch mode

In batch mode the macro can be executed following the next syntax:

where macro is the macro to be run (plot_raw_IC.mv, plot_forecastrun.mv or plot_ERAI_ERA5.mv); option1, option2 etc. are the settings listed above. A detailed help together with some useful examples is provided with simple execution of the macro:

The shell script scr_run_macros executes the macros from the UNIX/Linux shell and it can be tailored for the own needs.

External functions and macros

The prepared Metview macros use some external functions, macros and colour definitions which are placed in the definitions directory.

build_layout_2plus1  : layout definition with 2 left panels and 1 right panel
build_layout_single  : layout definition a single panel

titlemain            : title style for the main plot
titlemain_2L         : 2-line title style for the main plot
titlepanels          : title style for the individual panels

legend_main          : legend definition for a single page
legend_shade         : legend definition for left panels
legend_diff          : legend definition for right panel (for the difference field)

base_visdef          : colour definitions for the different variables
diff_range           : dynamic colour definitions for the difference fields

Input data

The input data are requested with the following content, format and name convention:

• Macro plot_raw_IC.mv expects the raw ICM* files as input: ICMCL${expID}INIT, ICMGG${expID}INIT, ICMGG${expID}INIUA, ICMSH${expID}INIT, where expID is the 4-digit experiment ID.
• Macros plot_forecastrun.mv and plot_ERAI_ERA5.mv expect grib files as input with the following file names: ${variable}_${date}.grib, where variable can be t2, mslp, p, gust, t850, q700, z500, u250, u100; date is day in format yyyymmdd.

Output figures

All the macros produce figures in single-page .ps files with the following file names:

• plot_raw_IC.mv: ${variable}_${level}_ERAI-ERA5_${date}+${timestep}.ps,
  where variable can be stl2, lnsp, z, t, cc, u, q; level can be 0 (in case of surface variables) or from 1 to 91; date is day in format yyyymmdd; timestep is forecast lead time in hours, e.g., 0, 3, 6 etc.
• plot_forecastrun.mv: ${variable}_${level}_${expID}_${date}+${timestep}.ps,
  where variable can be t2, mslp, p, gust, t, q, z, u; level  can be 0 (in case of surface variables) or 850, 700, 500, 250, 100; expID is the 4-digit experiment ID; date is day in format yyyymmdd; timestep is forecast lead time in hours, e.g., 0, 3, 6 etc.
• plot_ERAI_ERA5.mv: ${variable}_${level}_${reference}_${date}.ps,
  where variable can be t2, mslp, p, gust, t, q, z, u; level can be 0 (in case of surface variables) or 850, 700, 500, 250, 100; reference can be ERAI or ERA5; date is day in format yyyymmdd.

Running the Metview macros results in a large number of figures. To have an overview on them, a catalogue can be prepared which contains all relevant plots for the selected variable and a given investigation aspect in a concise format (see Figure 4 for illustration). To quickly generate this kind of album, the Macro functionality of the Microsoft Office programme can be used.

1. Convert the .ps files into .png files (images with 120 DPI are sharp enough with limited file size): convert -density 120 psfile pngfile
2. Choose a variable (e.g., T850) and open one of the .docx files in the figs/docs directory (initial_condition_t850_table.docx). Delete all figures from the table, but keep the table itself as it is.
3. Click on the View macros menu item in Macros menu point on View tab (in MS Office 2013) and edit the macro aainsertpicsOIFS_initialconditions. The macro source code can be seen in the opening window. The directory paths and file names can be replaced here to paths and file names valid in the local environment. This replacement can be done automatically with CTRL+H. Afterwards the macro has to be saved.
4. Then return to the the main document, position the cursor into the cell of the first picture and run the macro (with clicking on the View macros menu item in Macros menu point on View tab and running the macro aainsertpicsOIFS_initialconditions).
5. Save the document at the end of the macro run. The same can be repeated for all the variables.

Image Removed

References

<p><a name="hersbach"></a>Hersbach, H., Dee, D.P., 2016: <a href="https://www.ecmwf.int/en/newsletter/147/news/era5-reanalysis-production" target="_blank">ERA5 reanalysis is in production.</a> <em>ECMWF Newsletter 147,</em> p. 7.</p>