Introduction
We have a temporary but working version of the new tool grib-check available for CARRA/CERRA to try.
It has been updated with all related CARRA/CERRA more recent stuff (i.e. monthly/daily means, some newer parameters not existing in the first phases of the project etc.)
The temporary, still in progress, version can be downloaded from: https://drive.google.com/drive/folders/1Hq3EoDaA1EQtk2PRfWaTwc6S57Otmzvs?usp=drive_link
Follow the instruction in README to install and run it.
The related links:
- Support page for DGOV-399 CARRA daily and monthly GRIB headers
- table with all moda/dame options based on PaulBerrisford's older scripts
- SD-80276 - Getting issue details... STATUS
Monthly/daily mean data
The tool was run on all full sample moda/dame data in class=rr, for all origins:
(venv) [marm@ac6-101.bullx /perm/marm/sd/SD-80276_CERRA_em_es/test_crra_moda_full]$ l total 43412913 -rw-r----- 1 marm ma 163104260 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.HL.grib2 -rw-r----- 1 marm ma 1190228596 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.ML.grib2 -rw-r----- 1 marm ma 494014999 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.PL.grib2 -rw-r----- 1 marm ma 51541816 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.SFC.grib2 -rw-r----- 1 marm ma 2468532 Oct 10 16:16 DAME.NO-AR-CE.20200101.AN.SOL.grib2 -rw-r----- 1 marm ma 19744667 Oct 10 16:16 DAME.NO-AR-CE.20200101.FC.SFC.grib2 -rw-r----- 1 marm ma 283538420 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.HL.grib2 -rw-r----- 1 marm ma 2091912073 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.ML.grib2 -rw-r----- 1 marm ma 854705236 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.PL.grib2 -rw-r----- 1 marm ma 71946517 Oct 10 16:16 DAME.NO-AR-CW.20200101.AN.SFC.grib2 -rw-r----- 1 marm ma 2074345182 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.HL.grib2 -rw-r----- 1 marm ma 11631156018 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.ML.grib2 -rw-r----- 1 marm ma 5218792744 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.PL.grib2 -rw-r----- 1 marm ma 382688237 Oct 10 16:57 DAME.NO-AR-PA.20231201.AN.SFC.grib2 -rw-r----- 1 marm ma 555304520 Oct 10 16:57 DAME.NO-AR-PA.20231201.FC.SFC.grib2 -rw-r--r-- 1 marm ma 125763055 Sep 3 13:32 DAME.SE-AL-EC.19920101.AN.HL.grib2 -rw-r--r-- 1 marm ma 969518824 Sep 3 13:32 DAME.SE-AL-EC.19920101.AN.ML.grib2 -rw-r--r-- 1 marm ma 331557145 Sep 3 13:32 DAME.SE-AL-EC.19920101.AN.PL.grib2 -rw-r--r-- 1 marm ma 34928743 Sep 3 13:32 DAME.SE-AL-EC.19920101.AN.SFC.grib2 -rw-r--r-- 1 marm ma 1392239 Oct 13 12:44 DAME.SE-AL-EC.19920101.AN.SOL.f1.grib2 -rw-r--r-- 1 marm ma 4176717 Sep 3 13:32 DAME.SE-AL-EC.19920101.AN.SOL.grib2 -rw-r--r-- 1 marm ma 89856070 Sep 3 13:32 DAME.SE-AL-EC.19920101.FC.SFC.grib2 -rw-r----- 1 marm ma 163104260 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.HL.grib2 -rw-r----- 1 marm ma 1248752671 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.ML.grib2 -rw-r----- 1 marm ma 533811370 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.PL.grib2 -rw-r----- 1 marm ma 52404295 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.SFC.grib2 -rw-r----- 1 marm ma 2468532 Oct 10 16:16 MODA.NO-AR-CE.20200101.AN.SOL.grib2 -rw-r----- 1 marm ma 69685194 Oct 10 16:16 MODA.NO-AR-CE.20200101.FC.SFC.grib2 -rw-r----- 1 marm ma 283538420 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.HL.grib2 -rw-r----- 1 marm ma 2165166367 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.ML.grib2 -rw-r----- 1 marm ma 923889847 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.PL.grib2 -rw-r----- 1 marm ma 70162120 Oct 10 16:16 MODA.NO-AR-CW.20200101.AN.SFC.grib2 -rw-r----- 1 marm ma 2074345182 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.HL.grib2 -rw-r----- 1 marm ma 11853397365 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.ML.grib2 -rw-r----- 1 marm ma 5342260159 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.PL.grib2 -rw-r----- 1 marm ma 387730808 Oct 10 16:57 MODA.NO-AR-PA.20231201.AN.SFC.grib2 -rw-r----- 1 marm ma 556955654 Oct 10 16:57 MODA.NO-AR-PA.20231201.FC.SFC.grib2 -rw-r--r-- 1 marm ma 125763055 Sep 3 13:32 MODA.SE-AL-EC.19920101.AN.HL.grib2 -rw-r--r-- 1 marm ma 969518824 Sep 3 13:32 MODA.SE-AL-EC.19920101.AN.ML.grib2 -rw-r--r-- 1 marm ma 331557145 Sep 3 13:32 MODA.SE-AL-EC.19920101.AN.PL.grib2 -rw-r--r-- 1 marm ma 35087855 Sep 3 13:32 MODA.SE-AL-EC.19920101.AN.SFC.grib2 -rw-r--r-- 1 marm ma 4176717 Sep 3 13:32 MODA.SE-AL-EC.19920101.AN.SOL.grib2 -rw-r--r-- 1 marm ma 90105434 Sep 3 13:32 MODA.SE-AL-EC.19920101.FC.SFC.grib2
Results
The outputs of grib-check with some issues are attached.
identified issues in moda/dame streams full sample data from all origins:
SE-AL-EC
- still in development (marsscratch only)
- not correct paramIDs are used to encode moda/dame fields (the same ones as for instantaneous should have been used)
- SD-80276 - Getting issue details... STATUS
NO-AR-PA
- high/medium/low cloud parameters use the WMO rather than originally required UERRA more specific definitions:
- typeOfSecondFixedSurface 255 instead of 8...
- should be defined as layer, not on level..
- WMO surface runoff 231010 is used instead of UERRA one 174008
- grib-check should fail with "FAIL: Could not find parameter" message
- currently it shows rather that another parameter was identified instead (231010) = to understand the root-cause..
- grib-check should fail with "FAIL: Could not find parameter" message
- accumulated fluxes are not fully correctly encoded as on Predefined level
- scaledValueOfFirstFixedSurface and scaleFactorOfFirstFixedSurface should be MISSING
- Time integral of snow evaporation flux (235072) has no bitmap
NO-AR-CE
- newly archived volumetric soil ice 260644 is not archived as soil layer as other UERRA param
- see e.g. Volumetric soil water
Surface roughness (climatological) (173)
To be clarified if it is changing or static fields as per SD-80276 - Getting issue details... STATUS
- CERRA - pending confrimation from Waheed Iqbal
- CARRA as per Eivind Stoeylen
In the CARRA system we have roughness at forecast time which is used in the model. This parameter is however unfortunately not archived in MARS.
We also have roughness lengths at analysis time which ARE archived in MARS. These are however climatological ones and not varying! We will omit including these for our daily/monthly products.