Introduction

We have a temporary but working version of the new tool grib-check available for CARRA/CERRA to try. 

It has been updated with all related CARRA/CERRA more recent stuff (i.e. monthly/daily means, some newer parameters not existing in the first phases of the project etc.)

The temporary, still in progress, version can be downloaded from: https://drive.google.com/drive/folders/1Hq3EoDaA1EQtk2PRfWaTwc6S57Otmzvs?usp=drive_link

Follow the instruction in README to install and run it.

The related links:

Monthly/daily mean data

The tool was run on all full sample  moda/dame data in class=rr, for all origins:

(venv) [marm@ac6-101.bullx /perm/marm/sd/SD-80276_CERRA_em_es/test_crra_moda_full]$ l
total 43412913
-rw-r----- 1 marm ma   163104260 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.HL.grib2
-rw-r----- 1 marm ma  1190228596 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.ML.grib2
-rw-r----- 1 marm ma   494014999 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.PL.grib2
-rw-r----- 1 marm ma    51541816 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.SFC.grib2
-rw-r----- 1 marm ma     2468532 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.SOL.grib2
-rw-r----- 1 marm ma    19744667 Oct 10 16:16 DAME.NO-AR-CE.20200101.FC.SFC.grib2
-rw-r----- 1 marm ma   283538420 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.HL.grib2
-rw-r----- 1 marm ma  2091912073 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.ML.grib2
-rw-r----- 1 marm ma   854705236 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.PL.grib2
-rw-r----- 1 marm ma    71946517 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.SFC.grib2
-rw-r----- 1 marm ma  2074345182 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.HL.grib2
-rw-r----- 1 marm ma 11631156018 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.ML.grib2
-rw-r----- 1 marm ma  5218792744 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.PL.grib2
-rw-r----- 1 marm ma   382688237 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.SFC.grib2
-rw-r----- 1 marm ma   555304520 Oct 10 16:57 DAME.NO-AR-PA.20231201.FC.SFC.grib2
-rw-r--r-- 1 marm ma   125763055 Sep  3 13:32 DAME.SE-AL-EC.19920101.AN.HL.grib2
-rw-r--r-- 1 marm ma   969518824 Sep  3 13:32 DAME.SE-AL-EC.19920101.AN.ML.grib2
-rw-r--r-- 1 marm ma   331557145 Sep  3 13:32 DAME.SE-AL-EC.19920101.AN.PL.grib2
-rw-r--r-- 1 marm ma    34928743 Sep  3 13:32 DAME.SE-AL-EC.19920101.AN.SFC.grib2
-rw-r--r-- 1 marm ma     1392239 Oct 13 12:44 DAME.SE-AL-EC.19920101.AN.SOL.f1.grib2
-rw-r--r-- 1 marm ma     4176717 Sep  3 13:32 DAME.SE-AL-EC.19920101.AN.SOL.grib2
-rw-r--r-- 1 marm ma    89856070 Sep  3 13:32 DAME.SE-AL-EC.19920101.FC.SFC.grib2
-rw-r----- 1 marm ma   163104260 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.HL.grib2
-rw-r----- 1 marm ma  1248752671 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.ML.grib2
-rw-r----- 1 marm ma   533811370 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.PL.grib2
-rw-r----- 1 marm ma    52404295 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.SFC.grib2
-rw-r----- 1 marm ma     2468532 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.SOL.grib2
-rw-r----- 1 marm ma    69685194 Oct 10 16:16 MODA.NO-AR-CE.20200101.FC.SFC.grib2
-rw-r----- 1 marm ma   283538420 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.HL.grib2
-rw-r----- 1 marm ma  2165166367 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.ML.grib2
-rw-r----- 1 marm ma   923889847 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.PL.grib2
-rw-r----- 1 marm ma    70162120 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.SFC.grib2
-rw-r----- 1 marm ma  2074345182 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.HL.grib2
-rw-r----- 1 marm ma 11853397365 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.ML.grib2
-rw-r----- 1 marm ma  5342260159 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.PL.grib2
-rw-r----- 1 marm ma   387730808 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.SFC.grib2
-rw-r----- 1 marm ma   556955654 Oct 10 16:57 MODA.NO-AR-PA.20231201.FC.SFC.grib2
-rw-r--r-- 1 marm ma   125763055 Sep  3 13:32 MODA.SE-AL-EC.19920101.AN.HL.grib2
-rw-r--r-- 1 marm ma   969518824 Sep  3 13:32 MODA.SE-AL-EC.19920101.AN.ML.grib2
-rw-r--r-- 1 marm ma   331557145 Sep  3 13:32 MODA.SE-AL-EC.19920101.AN.PL.grib2
-rw-r--r-- 1 marm ma    35087855 Sep  3 13:32 MODA.SE-AL-EC.19920101.AN.SFC.grib2
-rw-r--r-- 1 marm ma     4176717 Sep  3 13:32 MODA.SE-AL-EC.19920101.AN.SOL.grib2
-rw-r--r-- 1 marm ma    90105434 Sep  3 13:32 MODA.SE-AL-EC.19920101.FC.SFC.grib2

Results

The outputs of grib-check with some issues are attached.

identified issues in moda/dame streams full sample data from all origins:

SE-AL-EC
  • still in development (marsscratch only)
  • not correct paramIDs are used to encode moda/dame fields (the same ones as for instantaneous should have been used)
    • SD-80276 - Getting issue details... STATUS
NO-AR-PA
  • high/medium/low cloud parameters use the WMO rather than originally required UERRA more specific definitions:
  •   WMO surface runoff 231010 is used instead of UERRA one 174008
    • grib-check should fail with "FAIL: Could not find parameter" message
      • currently it shows rather that another parameter was identified instead (231010) = to understand the root-cause..
  • accumulated fluxes are not fully correctly encoded as on Predefined level
    • scaledValueOfFirstFixedSurface and scaleFactorOfFirstFixedSurface should be MISSING
  • Time integral of snow evaporation flux (235072) has no bitmap
NO-AR-CE
  • newly archived volumetric soil ice 260644 is not archived as soil layer as other UERRA param
Surface roughness (climatological) (173)

To be clarified if it is changing or static fields as per SD-80276 - Getting issue details... STATUS

  • CERRA - pending confrimation from Waheed Iqbal 
  • CARRA as per Eivind Stoeylen 
    • In the CARRA system we have roughness at forecast time which is used in the model. This parameter is however unfortunately not archived in MARS.

    • We also have roughness lengths at analysis time which ARE archived in MARS. These are however climatological ones and not varying! We will omit including these for our daily/monthly products.


  • No labels