...
- Unpack oifs-ac-43r3-initcond.tgz into /data/openifs-ac which results in a directory /data/openifs-ac/INITIAL-CONDITIONS. The files therein are initial data files for the first day of month for all 12 months of 2010.
- Unpack ICMCL-2010.tgz into /data/openifs-ac which results in a directory /data/openifs-ac/ICMCL. This directory contains monthly files with surface boundary conditions (e.g. SSTs, soil temps, albedos, LAI etc).
- From you conventional OpenIFS installation's
OIFS_DATA_DIRcopy the directories ifsdata and rtables to /data/openifs-ac/43r3 as they are also needed here. - Further, create a directory /data/openifs-ac/43r3/wam which needs to contain wave model initial data for 2010-01-01. (presently files are copied over from cca:/lus/snx11062/scratch/ms/nl/nm6/ECE-DATA/OPENIFS/43r3)
Building the model
On both the ECMWF HPC Atos Cray and the ECMWF Atos Sequana HPCs it is possible to compile the model using a login node. On the ECMWF Cray XC40 it is recommended to open an interactive session on a MOM node for compilation:However, in order to complete the acceptance testing with chemistry an interactive node should be requested.
| Code Block | ||||
|---|---|---|---|---|
| ||||
% qsub -I -q dp -l EC_total_tasks=12 -l EC_job_tmpdir=10G -l EC_memory_per_task=3G |
| Code Block | ||||
|---|---|---|---|---|
| ||||
% ecinteractive -c 12 -m 32GB -t 06:00:00 |
If you have a configuration script that sets the appropriate environment for OpenIFS you If you have a configuration script that sets the appropriate environment for OpenIFS you should run this first before building the model executables.
...
| Note |
|---|
Note: If the XIOS server is to be used in the t21test experiments (option |
Note: only tm5 chemistry seems to work, model fails with b
Running OpenIFS/AC in Forecast or Climate Mode
(this section contains old stuff, move on to Steps to carry out an experiment)
The model is set up to run at Tl255L91 and it can be run in one of two modes:
Forecast mode: The model carries out a brief fc experiment with daily restart files. The intention is to restart the model every 1 or 2 days with new meteorological initial data obtained from ea or od, while the chemical fields are retained from the restart file in order to simulate the evolution of the atmospheric chemistry with time.
Climate mode: The model is run continuously for a longer period fc experiment while the dynamics is nudged every 6 hours to ei analyses (which were interpolated from 60 to 91 levels).
The default experiment ID is set as abcd and the model is set up such that it runs on $SCRATCH of the HPC.
$SCRATCH/43r3/experiments/abcd/chem_ic/ will contain the chemical initial and boundary conditions for the experiment.
configuration file in the |
Note: only tm5 chemistry seems to work, model fails with b$SCRATCH/43r3/experiments/abcd/runs/ will contain the experiment directory.
Steps to carry out an experiment
...
- create a machine config file: oifs-config.medamk.sh (we can re-use the one used in t21test_xios_t255ac)
- create a wrapper script to submit the batch job; the following templates exist:
- ecmwf-cca.job.tmpl – run oifs without XIOS (try this first!) this is virtually the same as $OIFS_HOME/AC-experiments/run-cca.job
- ecmwf-cca+xios.job.tmpl – run oifs with XIOS this is virtually the same as $OIFS_HOME/AC-experiments/run-cca+xios.job
- ecmwf-cca-workflow.sh – workflow for a run with a series of restarts
...
- in oifs-run.sh change platform to 'me ' (or 'damk' in this case)
- in run-cca.job delete the accounting PBS header line:
#PBS -l EC_billing_account=nlchekli
...