Introduction

We have a temporary but working version of the new tool grib-check available for CARRA/CERRA to try.

It has been updated with all related CARRA/CERRA more recent stuff (i.e. monthly/daily means, some newer parameters not existing in the first phases of the project etc.)

The temporary, still in progress, version can be downloaded from: https://drive.google.com/drive/folders/1Hq3EoDaA1EQtk2PRfWaTwc6S57Otmzvs?usp=drive_link

Follow the instruction in README to install and run it.

The related links:

Support page for DGOV-399 CARRA daily and monthly GRIB headers
- table with all moda/dame options based on PaulBerrisford's older scripts

Findings

The tool was run on all full sample moda/dame data in class=rr, for all origins:

(venv) [marm@ac6-101.bullx /perm/marm/sd/SD-80276_CERRA_em_es/test_crra_moda_full]$ l
total 43412913
-rw-r----- 1 marm ma   163104260 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.HL.grib2
-rw-r----- 1 marm ma  1190228596 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.ML.grib2
-rw-r----- 1 marm ma   494014999 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.PL.grib2
-rw-r----- 1 marm ma    51541816 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.SFC.grib2
-rw-r----- 1 marm ma     2468532 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.SOL.grib2
-rw-r----- 1 marm ma    19744667 Oct 10 16:16 DAME.NO-AR-CE.20200101.FC.SFC.grib2
-rw-r----- 1 marm ma   283538420 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.HL.grib2
-rw-r----- 1 marm ma  2091912073 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.ML.grib2
-rw-r----- 1 marm ma   854705236 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.PL.grib2
-rw-r----- 1 marm ma    71946517 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.SFC.grib2
-rw-r----- 1 marm ma  2074345182 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.HL.grib2
-rw-r----- 1 marm ma 11631156018 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.ML.grib2
-rw-r----- 1 marm ma  5218792744 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.PL.grib2
-rw-r----- 1 marm ma   382688237 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.SFC.grib2
-rw-r----- 1 marm ma   555304520 Oct 10 16:57 DAME.NO-AR-PA.20231201.FC.SFC.grib2
-rw-r--r-- 1 marm ma   125763055 Sep  3 13:32 DAME.SE-AL-EC.19920101.AN.HL.grib2
-rw-r--r-- 1 marm ma   969518824 Sep  3 13:32 DAME.SE-AL-EC.19920101.AN.ML.grib2
-rw-r--r-- 1 marm ma   331557145 Sep  3 13:32 DAME.SE-AL-EC.19920101.AN.PL.grib2
-rw-r--r-- 1 marm ma    34928743 Sep  3 13:32 DAME.SE-AL-EC.19920101.AN.SFC.grib2
-rw-r--r-- 1 marm ma     1392239 Oct 13 12:44 DAME.SE-AL-EC.19920101.AN.SOL.f1.grib2
-rw-r--r-- 1 marm ma     4176717 Sep  3 13:32 DAME.SE-AL-EC.19920101.AN.SOL.grib2
-rw-r--r-- 1 marm ma    89856070 Sep  3 13:32 DAME.SE-AL-EC.19920101.FC.SFC.grib2
-rw-r----- 1 marm ma   163104260 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.HL.grib2
-rw-r----- 1 marm ma  1248752671 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.ML.grib2
-rw-r----- 1 marm ma   533811370 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.PL.grib2
-rw-r----- 1 marm ma    52404295 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.SFC.grib2
-rw-r----- 1 marm ma     2468532 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.SOL.grib2
-rw-r----- 1 marm ma    69685194 Oct 10 16:16 MODA.NO-AR-CE.20200101.FC.SFC.grib2
-rw-r----- 1 marm ma   283538420 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.HL.grib2
-rw-r----- 1 marm ma  2165166367 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.ML.grib2
-rw-r----- 1 marm ma   923889847 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.PL.grib2
-rw-r----- 1 marm ma    70162120 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.SFC.grib2
-rw-r----- 1 marm ma  2074345182 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.HL.grib2
-rw-r----- 1 marm ma 11853397365 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.ML.grib2
-rw-r----- 1 marm ma  5342260159 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.PL.grib2
-rw-r----- 1 marm ma   387730808 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.SFC.grib2
-rw-r----- 1 marm ma   556955654 Oct 10 16:57 MODA.NO-AR-PA.20231201.FC.SFC.grib2
-rw-r--r-- 1 marm ma   125763055 Sep  3 13:32 MODA.SE-AL-EC.19920101.AN.HL.grib2
-rw-r--r-- 1 marm ma   969518824 Sep  3 13:32 MODA.SE-AL-EC.19920101.AN.ML.grib2
-rw-r--r-- 1 marm ma   331557145 Sep  3 13:32 MODA.SE-AL-EC.19920101.AN.PL.grib2
-rw-r--r-- 1 marm ma    35087855 Sep  3 13:32 MODA.SE-AL-EC.19920101.AN.SFC.grib2
-rw-r--r-- 1 marm ma     4176717 Sep  3 13:32 MODA.SE-AL-EC.19920101.AN.SOL.grib2
-rw-r--r-- 1 marm ma    90105434 Sep  3 13:32 MODA.SE-AL-EC.19920101.FC.SFC.grib2

Results

The outputs of grib-check with some issues are attached.

identified issues in moda/dame streams full sample data from all origins:

SE-AL-EC

not correct paramIDs are used to encode moda/dame fields (the same ones as for instantaneous should have been used)

NO-AR-PA

high/medium/low cloud parameters use the WMO rather than originally required UERRA more specific definitions:
- typeOfSecondFixedSurface 255 instead of 8...
- should be defined as layer, not on level..
  - https://confluence.ecmwf.int/display/UER/Low+cloud+cover
WMO surface runoff 231010 is used instead of UERRA one 174008
- grib-check should fail with "FAIL: Could not find parameter" message
  - currently it shows rather that another parameter was identified instead (231010) = to understand the root-cause..
accumulated fluxes are not fully correctly encoded as on Predefined level
- scaledValueOfFirstFixedSurface and scaleFactorOfFirstFixedSurface should be MISSING
Time integral of snow evaporation flux (235072) has no bitmap

NO-AR-CE

newly archived volumetric soil ice 260644 is not archived as soil layer as other UERRA param
- see e.g. Volumetric soil water