Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Login to ECMWF Cray

Each participant will have a training user account on the ECMWF Cray system. This is different from the user account on the classroom computers.

...

This is the directory in which we will run OpenIFS.

Creating the OpenIFS ensemble experiment

An ensemble experiment consists of a 'control' and multiple 'perturbed' forecasts, or 'ensemble members'. For the operational ECMWF ensemble forecast, 50 members are used.

...

The exercises show how to create the experiment directories, prepare the jobs and submit them to the ECMWF Cray.

createENS command

Use the command createENS to create the ensemble experiment:

...

Code Block
createENS --help

usage: createENS [-h] -d <startdate/enddate/hr_inc> [-m <members>]
Set up ensemble forecast for the OpenIFS 2015 workshop
optional arguments:
  -h, --help            show this help message and exit
  -d <startdate/enddate/hr_inc>, --date <startdate/enddate/hr_inc>
                        List of date(s) to retrieve, format: YYYYMMDDHH. The
                        only dates available are: 2013102400/2013102700/24
  -m <members>, --members <members>
                        Number of ensemble members to create e.g. 3 (default 1)

Exercise

Change to the experiment directory labelled by the date chosen:

...

Understand what the different files in the experiment directory are for.

Initial files

ICM* : these are the initial starting files. ICMGG* are the initial gridpoint files, ICMSH* are the initial spectral fields.

...

Code Block
grib_ls ICMGGoifsINIT
grib_ls ICMSHoifsINIT

Fortran namelist

The file: namelistfc is the model 'NAMELIST'. It contains a list of variable settings or 'switches' that control what the model does. These variables are grouped into separate fortran namelists.

The model will read this file when it starts up. There are many options to control the model. For more information, it is best and recommended to check the comments in the code. Please ask if you are interested.

Creating the OpenIFS namelist

Set the ensemble member

In IFS, each ensemble member uses the stochastic physics schemes to generate uncertainty. A random number 'seed' is used by the stochastic scheme to generate a different forecast. This random number seed is changed by altering the ensemble member value in the model's namelist. Each ensemble member must have a unique number and therefore random number seed, in order to produce a different forecast.

Exercise

Info

Make sure you are in the 'pf001' directory.

Make a copy of the namelist file and edit it to set the ensemble member value to the one you are given.

...

Note

This is different from how the ensemble would be run in practice. Ensemble member '2' would be run in directory pf002, member number '3' in pf003 and so on. But to keep this exercise simple, everyone will use the same experiment directory name but with a different ensemble member number.

Create and submit Cray batch job

The next steps are to create and submit a batch job to run on the ECMWF Cray XC30 system.

...

Panel
borderColorgrey
bgColorwhite
borderWidth1
titleBGColorwhite
borderStyledotted
titleoifs_run command

oifs_run -e exptid  [-l namelist] [-f fcast len]

For this exercise the only arguments to use are: -e, -l, -f. Other options are available which can be left to their default values.

Note!  the -f argument, the length of the forecast, is specified as: dNN, for example d10 means '10 days'.

Exercise

Use the oifs_run command to create the job.

...

These are the model output files. There is 1 per output interval. In these experiments the output interval is every 3 hours.

Checking the model output

After the qstatu command shows that the job has completed, there will be a 'batch log file' in the pf001 directory:

Code Block
languagebash
titleExample batch job logfile
oifs_troifs1.o1481792

Exercise

Using your favourite text editor, check this file to make sure the model has run correctly.  It's usually best to start from the bottom of the file and scroll up.

...

Panel
bgColorwhite
titleBGColorwhite
titleContents of output directory after successful run

When the model completes the forecast successfully, the following files will be found in the output directory. Files with '+' in the name are the model output files. ICMSH are the spectral fields, ICMGG are the gridpoint fields.

 

ICMGGoifs+000000  ICMGGoifs+000048  ICMGGoifs+000096  ICMGGoifs+000144  ICMSHoifs+000016  ICMSHoifs+000064  ICMSHoifs+000112  ICMSHoifs+000160  oifs.log

ICMGGoifs+000016  ICMGGoifs+000064  ICMGGoifs+000112  ICMGGoifs+000160  ICMSHoifs+000032  ICMSHoifs+000080  ICMSHoifs+000128  NODE.001_01

ICMGGoifs+000032  ICMGGoifs+000080  ICMGGoifs+000128  ICMSHoifs+000000  ICMSHoifs+000048  ICMSHoifs+000096  ICMSHoifs+000144  ifs.stat

Preparing files for Metview

The next step is to take the output of the successful run and prepare it for the Metview based exercises.

...