Contents of the sample static dataset

To help users begin planning for the migration, we have produced an initial static sample dataset which provides sample data encoded in GRIB edition 2 from: 

• the analysis and forecast from the control (ex-HRES):
  • atmosphere:  stream=oper, type=an and type=fc
  • wave: stream=wave, type=an and type=fc
• the perturbed members from the ENS forecast 
  
  • atmosphere stream=enfo, type=pf
  • wave:  stream=waef, type=pf

Sample data encoded in GRIB2 from the ensemble post-processed products (ensemble mean, maximum, etc, EFI and Sot), ensemble hindcasts, sub-seasonal and sub-seasonal hindcasts will also be made available in due course.

The sample data are based on the output from the current IFS cy49r1 output for the 00 UTC cycle on 30 November 2024 but encoded in GRIB2 as the data which will be produced by IFS cy51r1 are currently expected to be encoded.  All fields provided are global and interpolated to a 1.0° x1.0° regular latitude-longitude grid.

• Data on constant pressure levels (type=pl) are provided at level=100 only.
  
• Data on theta levels (type=pt) are provided at level=300 for type=fc and level=265 only for type=an.
• Data on potential vorticity levels (levtype=pv) are provided at level=1500 only.
• Data on model levels (levtype=ml) are provided at level=1 only.
• Parameters accumulated from the start of the forecast have the ecCodes startStep key consistently set to 0 and, consequently, have stepRange=0-24, etc. 
• Parameters accumulated from the start of the forecast are not provided at stepRange=0. 
• Data from ENS forecasts are provided for a single ensemble member only (number=1).

Where to obtain the static sample dataset

• Users with login access to the ECMWF HPC service can access the data from the directory /ec/vol/mtg2_sample. 
• Users without login access to the ECMWF HPC or ECS service can download the data from https://data.ecmwf.int/mtg2_sample/.

On both the ECMWF HPC and the web server, the data are organised in a directory structure described in the next section.

Directory structure of static sample dataset

Data are ordered in a MARS-like folder structure under <root_dir>/<class>/<stream>/<type>/<levtype>.  Shown below is a diagrammatic layout of the structure under <root_dir>=/ec/vol/mtg2_sample/: 

<root_dir>/od/enfo
└── pf
    ├── pl
    ├── pt
    ├── pv
    ├── sfc
    └── sol

<root_dir>/od/oper
├── an
│   ├── ml
│   ├── pl
│   ├── pt
│   ├── pv
│   ├── sfc
│   └── sol
└── fc
    ├── ml
    ├── pl
    ├── pt
    ├── pv
    ├── sfc
    └── sol

<root_dir>/od/waef
└── pf
    └── sfc

<root_dir>/od/wave
├── an
│   └── sfc
└── fc
    └── sfc

Structure of file names

Each directory at the end of a branch of the tree contains one file per parameter with all forecast time steps.  The files are named <paramId>_<class>_<stream>_<type>_<levtype>_<shortName>_<year>_<expver>_<gridType>.grib2 and are based on the ecCodes paramId, shortName and gridType and the MARS class, stream, type, levtype used for the current operational output at IFS cy49r1.

For example, the file named 151_od_oper_fc_sfc_msl_2024_0001_regular_ll.grib2 in the <root_dir>/od/oper/fc/sfc/ directory contains the GRIB2 encoding of mean sea-level pressure from the Control (ex-HRES) forecast at all available forecast steps. 

Who should use the initial static sample dataset ?

The initial static sample dataset is aimed at GRIB encoding and decoding specialists that need early access to samples of ECMWF GRIB2 data to test and prepare any decoding software used that is not based on ECMWF ecCodes GRIB encoding and decoding software to handle the GRIB2 ECMWF data.  The dataset is not suitable for the general users of ECMWF data that want to test their full processing chain.

Sample data for the general user will be made available in the coming months when it will be possible to download the data from the ECMWF MARS archive and process the data using versions of ECMWF software, such as ecCodes and Metview that fully support the new ECMWF GRIB2 encoding.

What can be tested using the static sample dataset ?

The static sample dataset can be used for making some basic tests using your GRIB decoder to ensure the data can be read correctly.  In particular, testing is encouraged if you use a third-party GRIB decoder, such as wgrib2, which is not based on ecCodes.

If your decoder is based on ecCodes then ecCodes version 2.42.0 should be used  - see ecCodes version 2.42.0 released.  This is available for download from our ecCodes Releases page.

For users with access to the ECMWF Atos HPC, ecCodes 2.42.0 is also installed as part of the 2025.06.0.0 version of the ecmwf-toolbox.  This can be accessed on the Atos using:

$ module load ecmwf-toolbox/2025.06.0.0

$ grib_ls -V

ecCodes Version 2.42.0

Version 2025.06.0.0 of the ecmwf-toolbox also provides an installation of Metview linked with ecCodes 2.42.0 and which can be used to test Metview code that process the static sample data.

The static sample dataset can be decoded by versions of ecCodes older than 2.42.0 but some keys, in particular the shortName and paramId, may not be set correctly.  However, it is possible use the grib_dump tool to inspect the GRIB headers and here the keys are set to the correct values as far as we are aware.

In general, the static sample dataset  is not suitable for initialising an NWP model.  Although encoding examples of all parameters at all forecast steps are provided, for those parameters on constant pressure levels, for example, only the 1hPa level is provided.  However, users that use initial and lateral boundary conditions (LBCs) from ECMWF data to initialise and update their NWP models should note the change in the way the parameters on soil levels are provided as this may require changes to your code.  Instead of having four separate parameters at each soil layer (level), in GRIB2 there will be one parameter available at each of the four layers - see Soil temperature, volumetric soil moisture and sea-ice temperature, below, for details.

Other sources of ECMWF GRIB2 data that can be used for testing

Along with the static sample dataset, users can also use the ECMWF Open Data to test their processing of GRIB2 data.  All of the open data are encoded in GRIB2.  For more information about these data and how to obtain them, see ECMWF open data: real-time forecasts from IFS and AIFS.

Changes to encoding of parameter paramId, shortName, name and units

The encoding of the ecCodes paramId, shortName, name and units have changed for some surface parameters from the analysis and forecast.  Users may need to adapt their workflows in order to process these parameters successfully.  The main changes affecting parameters provided in the static sample dataset are summarised below.  For a list of all changes to parameter encoding made at each ecCodes version, see Migration to GRIB2 - new in ecCodes.

Soil temperature, volumetric soil moisture and sea-ice temperature

In GRIB1, soil temperature, volumetric soil moisture and sea-ice temperature have different paramIds for each of the 4 soil layers.  In GRIB2, only a single paramId is used with the layer indicated by the level key.

For example, in GRIB1, there is a paramId for Volumetric soil water layer 1 and a different paramId for Volumetric soil water layer 2, etc.  In GRIB2, only a single paramId is used for Volumetric soil water, with the layer 1 having level=1 and layer 2 having level=2. 

These parameters will be archived in MARS with levtype=sol (surface other levels).  To retrieve these parameters in GRIB2, users will need to change their MARS requests to specify levtype=sol,levelist=1/2/3/4.

Parameters statistically processed over a time window

In GRIB1, parameters that are statistically processed over a time window, such and maximum, minimum and average values over the last 3 or 6 hours, have different paramIds for each time window available.  In GRIB2, there is a unique paramId indicating the parameter and type of statistical processing, e.g., paramId=237167, shortName=max_2t for maximum temperature at 2 metres.  A separate key, called statisticalwindow, is then used to specify the time window.  For example, paramId=237167, statisticalwindow=3h identifies maximum temperature at 2 metres during the last 3 hours.

This change applies to:

• Maximum 10 metre wind gust.
• Maximum and minimum temperature at 2 metres.
• Maximum and minimum total precipitation rate.
• Maximum CAPE and CAPE shear.
• Average lightning flash density.
• Most severe and most frequent precipitation type.

To retrieve these parameters in GRIB2 from MARS, users will need to use the new paramId and also specify the statistical processing time window using a new MARS keyword - timespan - that is to be introduced. 

Maximum 10m wind gust

Key values that are different are highlighted in bold.

Maximum and minimum 2m temperature

Key values that are different are highlighted in bold.

Maximum and minimum total precipitation rate

Key values that are different are highlighted in bold.

Maximum CAPE and CAPE Shear

Key values that are different are highlighted in bold.

Mean total lightning flash density

Key values that are different are highlighted in bold.

Most severe and most frequent precipitation type

Key values that are different are highlighted in bold.

Ocean model output

The paramId's and shortNames for the following output from the ocean model have changed.  In addition:

• the unit of Sea surface practical salinity and Average sea water practical salinity in the upper 300 m has changed from psu to g/kg;
• the unit of the Average sea water potential temperature in the upper 300m has changed from degrees Celsius to Kelvin.

Key values that are different are highlighted in bold.

Parameters provided with WMO units

For some parameters, ECMWF has been providing values in units which are not the official WMO units.  The static sample dataset also includes examples of the same parameters but with values provided in the official WMO units.  These parameters are provided in files identified by the ECMWF paramId and shortName in the file name but with the additional tag "_wmo_units".  For example, the total precipitation parameter, which ECMWF has been providing in units of "metres" (m), is also provided in units of kg/m² in a file named 228_od_oper_fc_sfc_tp_2024_0001_regular_ll_wmo_units.grib2.

141_od_oper_an_sfc_sd_2024_0001_reduced_gg.grib2

15_od_oper_an_sfc_aluvp_2024_0001_reduced_gg.grib2

164_od_oper_an_sfc_tcc_2024_0001_reduced_gg.grib2

16_od_oper_an_sfc_aluvd_2024_0001_reduced_gg.grib2

174_od_oper_an_sfc_al_2024_0001_reduced_gg.grib2

17_od_oper_an_sfc_alnip_2024_0001_reduced_gg.grib2

186_od_oper_an_sfc_lcc_2024_0001_reduced_gg.grib2

187_od_oper_an_sfc_mcc_2024_0001_reduced_gg.grib2

188_od_oper_an_sfc_hcc_2024_0001_reduced_gg.grib2

18_od_oper_an_sfc_alnid_2024_0001_reduced_gg.grib2

198_od_oper_an_sfc_src_2024_0001_reduced_gg.grib2

206_od_oper_an_sfc_tco3_2024_0001_reduced_gg.grib2

210186_od_oper_an_sfc_aluvpi_2024_0001_reduced_gg.grib2

210187_od_oper_an_sfc_aluvpv_2024_0001_reduced_gg.grib2

210188_od_oper_an_sfc_aluvpg_2024_0001_reduced_gg.grib2

210189_od_oper_an_sfc_alnipi_2024_0001_reduced_gg.grib2

210190_od_oper_an_sfc_alnipv_2024_0001_reduced_gg.grib2

210191_od_oper_an_sfc_alnipg_2024_0001_reduced_gg.grib2

32_od_oper_an_sfc_asn_2024_0001_reduced_gg.grib2