Contributors: O. Bobryshev (DWD)

Issued by: DWD/ Oleksandr Bobryshev

Date: 09/06/2021

Ref: C3S_D312b_Lot1.3.5.1-v2.1_202007_PUGS_ECVSurfacRadiationBudget_v1.0

Official reference number service contract: 2018/C3S_312b_Lot1_DWD/SC1

Table of Contents

History of modifications

Version

Date

Description of modification

Chapters / Sections

V1.0

20/12/2018

First version

All

V1.1

28/02/2019

Full description of the net fluxes algorithms

All

V2.0

02/01/2021

Merged version for all CLARA Product Family

All

V2.1

19/05/2021

Update on Surface Radiation ICDR 2.x

Chapters 1,2,3

List of datasets covered by this document

Deliverable ID

Product title

Product type (CDR, ICDR)

Version number

Delivery date

D3.3.4-v2.0

Surface Radiation Budget AVHRR CLARA (known as brokered EUMETSAT's CM SAF CLARA-A2.1)

CDR

V2.0

30/10/2020

D3.3.5-v2.0

Surface Radiation Budget AVHRR (known as CLARA-A2.1-extra data products)

CDR

V2.0

30/10/2020

D3.3.4- v2.x-P6

Surface Radiation Budget AVHRR CLARA (known as brokered EUMETSAT's CM SAF CLARA-A2.1)

ICDR

V2.x

31/03/2021

D3.3.5-v2.x-P6

Surface Radiation Budget AVHRR (known as CLARA-A2.1-extra data products)

ICDR

V2.x

31/03/2021

Related documents

Reference ID

Document

D1

Algorithm Theoretical Basis Document CM SAF Cloud, Albedo, Radiation data record, AVHRR-based, Edition 2.1 (CLARA-A2.1), Surface Radiation, Issue 2.5


Link to CM SAF ATBD document

D2

Product User Manual CM SAF Cloud, Albedo, Radiation data record, AVHRR-based, Edition 2.1 (CLARA-A2.1), Surface Radiation Products, Issue 2.3


Link to CM SAF PUM document

D3

Validation Report,  CM SAF Cloud, Albedo, Radiation dataset, AVHRR-based, Edition 2.1 (CLARA-A2.1), Surface Radiation Products, Issue 2.4

 

Link to CM SAF Validation Report

D4

CM SAF Product Requirement Document, Issue 3.7


Available upon request from Deutscher Wetterdienst (DWD).

D5

Copernicus Common data model (CDM) specification – v1.0


Link to the Copernicus CDM

D6

C3S Product Quality Assessment Report, Surface Radiation Budget

 

Link to C3S PQAR document

D7

C3S Algorithm Theoretical Basis Document, Surface Radiation Budget

 

Link to C3S ATBD document

D8

Algorithm Theoretical Basis Document ICDR AVHRR, based on CLARA-A2 methods Surface Radiation, Surface Radiation, Issue 2.1


Link to CM SAF ATBD document ICDR

D9

[GCOS- 200] Global Climate Observing System, Implementation Plan, 2016. World Meteorological Organization, Geneva, Switzerland.


Link to GCOS-200 document

Acronyms

Acronym

Definition

ATBD

Algorithm Theoretical Basis Document

AVHRR

Advanced Very High Resolution Radiometer

CDR

Climate Data Record

CDS

Climate Data Store

CLARA-A2.1

CLARA-A2: CM SAF CLoud, Albedo and Radiation data record –
AVHRR based, Edition 2.1

CM SAF

Satellite Application Facility on Climate Monitoring

DWD

Deutscher Wetterdienst (German Meteorological Service)

ECV

Essential Climate Variable

EUMETSAT

European Organization for the Exploitation of Meteorological Satellites

ICDR

Interim Climate Data Record

MetOp

Meteorological Operational Satellite

NOAA

National Oceanic and Atmospheric Administration

PUM

Product User Manual

SAL

Surface Albedo

SDL

Surface Downwelling Longwave Radiation

SIS

Surface Incoming Shortwave Radiation

SNL

Surface Net Longwave radiation

SNS

Surface Net Shortwave radiation

SOL

Surface Outgoing Longwave Radiation

SRB

Surface Radiation Budget

SRS

Surface Reflected Shortwave radiation

SZA

Solar Zenith Angle

General definitions

In the scope of the Copernicus Climate Change Service (C3S), two Surface Radiation Budget datasets are combined into one Climate Data Record (CDR) called "CLARA product family".

The first dataset, EUMETSAT's CM SAF CLARA-A2.1, is the core of this CDR. The second dataset includes extra data products that are not included in the CLARA-A2.1 dataset. The core data products are brokered from CM SAF. The extra net fluxes are not included in the brokered CLARA-A2.1 dataset and are calculated specifically within the C3S project as complimentary data for the convenience of users. Their format is as close as possible to the CLARA-A2.1 and the datasets are meant to be used together. Both datasets are frequently updated with Interim Climate Data Records (ICDRs) or simply extensions, generated using the same software and algorithms to cover more recent periods. The ICDR part for all products covers period from 2019 to 2020.

This separation into two datasets is necessary to keep the origin of the data, e.g. licence affiliations: "EUMETSAT's CM SAF" and "C3S", clear for individual products (Table 1)

Table 1: Licence overview of the CLARA product family Surface Radiation Products available through the CDS

Year

CDR Type

CLARA Product Family

SIS

SDL, SOL

SRS

Net Fluxes

 

Longwave fluxes

Extra data products

1982 – 2018

TCDR

CM SAF (CLARA A2.1)

CM SAF (CLARA A2.1)

C3S

C3S

2019 – 2020

ICDR

CM SAF
(CLARA A2.1 ICDR)

C3S

C3S

C3S

The longwave fluxes are not included in the CM SAF ICDR plans for the current phase. To ensure the dataset integrity and continuity, they are calculated within the C3S for the ICDR part. As such, the longwave fluxes change their licence affiliation, namely they are provided within the C3S project for the ICDR part (2019-2020) and are brokered from EUMETSAT’s CM SAF for the TCDR part (1982 to 2018).

Furthermore the CM SAF CLARA-A2.1 dataset has a temporal coverage of January 1982 to June 2019 (as described in [D2]), but TCDR data are only being brokered to the CDS up to December 2018. Data available from the CDS for January 2019 to December 2020 are brokered/derived from the CLARA A2.1 ICDR1.

In contrast to the original CM SAF CLARA-A2.1 dataset, the brokered service within Copernicus solely provides:

  • Level-3 data – excluding the level-2b data format.
  • Data on a global equal angle grid – excluding the polar grid format.
  • An aggregated version of all satellite data – excluding the provision of the individual satellite datasets.

1 The CM SAF CLARA-A2.1 and CLARA-A2.1 ICDR have a 6 month overlap from 2019/01 to 2019/06. One of the input datasets used in CLARA-A2.1, namely ERA-interim reanalysis data, is only available until August 2019 and dates beyond that are only covered by the newer ECMWF reanalysis version (ERA-5) and ECMWF IFS model. The CLARA-A2.1 ICDR uses ERA data from January 2019 onwards. The 6-month overlap between CLARA-A2.1 and CLARA-A2.1 ICDR is needed to ensure a sufficient period for data comparison and validation. CM SAF ATBD-ICDR contains more information on the overlap period.

Scope of the document

This is the Product User Guide and Specification (PUGS) document for the CLARA Product Family CDR. It describes data products and data usage, lists target requirements and provides data access information. The data origin overview for all data products is given.
The brokered service within Copernicus solely refers to the CM SAF Validation Report. It can be found at the CM SAF web site http://www.cmsaf.eu with the copy of the main documents provided at the CDS website.
Extra data products produced within C3S are described in this document.

Executive summary

The brokering service of the CLARA-A2.1 data products includes 37 years (1982-2018) of level-3 data (monthly means) on a regular global latitude-longitude grid (with 0.25° x 0.25° resolution), merged from various polar orbiting satellites. It includes three products: the Surface Incoming Shortwave radiation (SIS), the Surface Outgoing Longwave radiation (SOL), and the Surface Downwelling Longwave radiation (SDL). SIS daily averages are also available within C3S. This document refers to the CM SAF documentation [D2] data products and data usage, lists target requirements and provides data access information.

The extra data products (produced specifically within the C3S project) are: the Surface Reflected Shortwave radiation (SRS), the Surface Net Shortwave radiation (SNS), the Surface Net Longwave radiation (SNL), and the Surface Radiation Budget (SRB). Data product descriptions for these extra data products are provided within this document.

The CLARA ICDR is a continuation of the products of the CLARA-A2.1 and the extra data products. It extends both products by 2 years (2019-2020) and further updates.

Table 2: Association table of CLARA product names and CF Standard names used in the CDS (Climate Data Store)

CLARA Long Names

CF Standard names

Surface Incoming Shortwave Radiation (SIS)

Surface downwelling shortwave flux

Surface Downwelling Longwave Radiation (SDL)

Surface downwelling longwave flux

Surface Outgoing Longwave Radiation (SOL)

Surface upwelling longwave flux

Surface Reflected Shortwave (SRS)

Surface upwelling shortwave flux

Surface Net Shortwave Radiation (SNS)

Surface net downward shortwave flux

Surface Net Longwave Radiation (SNL)

Surface net downward longwave flux

Surface Radiation Budget (SRB)

Surface net downward radiative flux

1. Data origin and licensing overview

In the scope of the Copernicus Climate Change Service (C3S), two Surface Radiation Budget datasets are combined into one Climate Data Record (CDR) called the "CLARA product family".
The first dataset, CLARA-A2.1, is the core of this CDR. The second dataset includes extra products that are not included in the CLARA-A2.1 CDR. The core data products are brokered from EUMETSAT's CM SAF. The extra data products are not included in the brokered CLARA-A2.1 dataset and are produced specifically within the C3S project as complimentary data for the convenience of users. The longwave fluxes are not included in the CM SAF ICDR plans, so to ensure the dataset integrity and continuity, they are calculated within the C3S for the ICDR part (2019-2020). As such, the longwave fluxes change their license affiliation from CM SAF to C3S for the ICDR part.

The extra data products are meant to be used together with CLARA-A2.1, they have file format and data parameters compatible with to CLARA-A2.1. This separation into two datasets is necessary to keep the origin of the data, e.g. license affiliations: "EUMETSAT's CM SAF" and "Copernicus", clear for individual products. Table 1 in the General definition section gives an overview for the license attribution of all products within this CDR.
The CDR provided here includes daily and monthly means of surface radiation properties on a regular global latitude-longitude grid, merged from various satellites. The TCDR comprises 37 years of data ranging from January 1982 to December 2018. The ICDR part extends the dataset by two more years: from January 2019 to December 2020.

In the TCDR, the data products brokered from CLARA-A2.1 are the Surface Incoming Shortwave radiation (SIS), the Surface Outgoing Longwave radiation (SOL), and the Surface Downwelling Longwave radiation (SDL). In the ICDR, Surface Incoming Shortwave radiation (SIS) is brokered from CLARA-A2.1, while the Surface Outgoing Longwave radiation (SOL), and the Surface Downwelling Longwave radiation (SDL) are generated with the C3S project, using CLARA-A2.1 input data. Therefore, as mentioned above, SOL and SDL for the ICDR part (2019-2020) change their license affiliation from CM SAF to C3S..

The extra data products are generated within C3S_312b Lot1 by the German Meteorological Service, Deutscher Wetterdienst (DWD). They consist of the Surface Reflected Shortwave radiation (SRS), the Surface Net Shortwave radiation (SNS), the Surface Net Longwave radiation (SNL) and the Surface Radiation Budget (SRB).
Note that the brokered service provides a subset of the original CLARA-A2-1 dataset, thus the mentioned products do not cover the entire range of surface radiation budget products contained in the original dataset.

2. Product description

This section provides the specific product description.

Table 3 shows a summary of the general product characteristics.

Table 3: Common characteristics of the brokered part of CM SAF Surface Radiation Budget of AVHRR CLARA-A2.1 and ICDR data

Characteristics

Description

Originating satellite sensor type

AVHRR Advanced Very High Resolution Radiometer with 4 to 6 VIS-IR channels

Data class

Earth Observation Data

Algorithm description reference

CM SAF ATBD Radiation [D1]

Geographic coverage

Global

Horizontal grid

0.25° longitude x 0.25° latitude

Temporal resolution

Monthly. Monthly and daily for the Surface Incoming Shortwave Radiation

Main variable

Surface radiation

Data format

CF-compliant NetCDF

Algorithm Level 3 processor

CM SAF GAC L3_V2.0

2.1 Surface Incoming Shortwave Radiation (SIS)

The brokered version of the CLARA-A2-1 SIS dataset contains daily and monthly means (level-3 data) on a global equal angle grid. The algorithm used to generate the product is outlined in CM SAF ATBD [D1], Section 2.1.1 and CM SAF ATBD ICDR [D8], Section 2.1.1

2.2 Surface Downwelling Longwave Radiation (SDL)

The brokered version of the CLARA-A2 surface downwelling longwave radiation dataset contains monthly means (level-3 data) on a global equal angle grid. The algorithm used to generate the product is outlined in CM SAF ATBD [D1], Section 2.2.1.

SDL is not included in the CM SAF ICDR plans for the current phase, so, for the ICDR dataset (2019-2020), SDL has been produced within the C3S contract.

Reanalysis data are a key input requirement for SDL product. The ERA-Interim reanalysis dataset (used for the TCDR) ended in August 2019, so for the whole ICDR period (2019-2020) ERA-5 data are used.  Other input and auxiliary data used for the ICDR are the same as for the TCDR.  

2.3 Surface Outgoing Longwave Radiation (SOL)

The brokered version of the CLARA-A2 surface outgoing longwave radiation dataset contains monthly means (level-3 data) on a global equal angle grid. The algorithm used to generate the product is outlined in CM SAF ATBD [D1], Section 2.2.2.

SOL is not included in the CM SAF ICDR plans for the current phase, so, for the ICDR dataset (2019 2020), SOL has been produced within the C3S contract.

Reanalysis data are a key input requirement for SOL product. The ERA-Interim reanalysis dataset (used for the TCDR) ended in August 2019, so for the whole ICDR period (2019-2020) ERA-5 data are used.  Other input and auxiliary data used for the ICDR are the same as for the TCDR.  

2.4 Surface Reflected Shortwave Radiation (SRS)

The SRS product is generated from the Surface Incoming Shortwave Radiation (SIS) from EUMETSAT’s CM SAF CLARA-A2.1 [D1] and the Surface Albedo (SAL) from CLARA-A2.1 dataset (monthly means). SRS ICDR is generated in the same way as TCDR.

2.5 Surface Net Shortwave Radiation (SNS)

The SNS product is generated from the Surface Incoming Shortwave Radiation (SIS) from EUMETSAT’s CM SAF CLARA-A2.1 [D1] and the Surface Reflected Shortwave Radiation (SRS). SNS ICDR is generated in the same way as TCDR.

2.6 Surface Net Longwave Radiation (SNL)

The SNL product is generated from the Surface Downwelling Longwave radiation (SDL) and the Surface Outgoing Longwave radiation (SOL) brokered from EUMETSAT’s CM SAF CLARA-A2 [D1]. SNL ICDR is generated in the same way as TCDR.

2.7 Surface Radiation Budget (SRB)

The SRB product is generated from the SNS and the SNL, described above.

3. Target requirements

A general overview of user requirements needed for climate monitoring is provided in CM SAF Product Requirements Document [D4]. They were formulated in a dialogue with experts and potential users when there was no guidance from GCOS documents for surface radiation products.

New GCOS requirements for the ECV Surface Radiation Budget are summarized in GCOS-200, Table 23, page 279 and include requirements for the horizontal resolution, temporal resolution, accuracy and stability. GCOS targets are:

  • Frequency: Monthly (resolving diurnal cycle)
  • Resolution: 100 km
  • Measurement uncertainty: \( 1\ W/m^2 \) on global mean

  • Stability: \( 0.2\ W/m^2dec \)

However, these requirements are only valid for the net fluxes (i.e., SNS and SNL) and not for all individual radiation budget components. Having said that, one could claim that individual radiation budget components should consequently be constrained in the same way as net fluxes.

All products in the brokered CLARA-A2.1 dataset fulfil the GCOS requirements regarding the horizontal and temporal resolution. However, the SNS and SNL products do not fulfil the new requirements on accuracy and stability which are very stringent. Nevertheless, achieved accuracy and stability results [see D6] allow consistent quantification of mean values, anomalies, variability and the Earth energy budget in general. We point out the existing uncertainties in the methodology of comparison with area-to point measurements (i.e. satellite-area to point-ground-based reference networks) as important reasons for not fulfilling the new GCOS requirements.

3.1 Surface Incoming Shortwave Radiation

A complete TCDR evaluation of the SIS daily and monthly means is outlined in CM SAF Validation Report [D3], Sections 5.2, 5.2.1 and 5.2.2.

A summary on the accuracy evaluation is given in CM SAF Validation Report [D3], Tables 5-1 and 5-2. Summary on the stability evaluation is given in CM SAF Validation Report [D3], Figure 5-3.

ICDR Accuracy and stability evaluations are given in CM SAF Validation Report ICDR [D10].

Achieved accuracy and stability fulfil the CM SAF product requirements [D4].

3.2 Surface Downwelling Longwave Radiation

The predefined requirements for the SDL are given in CM SAF Product Requirement Document [D4], Annex A. A complete evaluation of the SDL TCDR is outlined in CM SAF Validation Report [D3], Section 5.4. The accuracy estimation of SDL ICDR extension is performed within the C3S using the algorithms developed by CM SAF.

Summary on the TCDR accuracy evaluation is given in CM SAF Validation Report [D3], Table 5-4. Summary on the TCDR stability evaluation is given in CM SAF Validation Report [D3], Figure 5-12.

Achieved accuracy and stability fulfil the CM SAF product requirements [D4]..

3.3 Surface Outgoing Longwave Radiation

The predefined requirements for the SOL are given in CM SAF Product Requirement Document [D4], Annex A. A complete evaluation of the SOL TCDR is outlined in CM SAF Validation Report [D3], Section 5.3. The accuracy estimation of SOL ICDR extension is performed within the C3S using the algorithms developed by CM SAF.

Summary on the TCDR accuracy evaluation is given in CM SAF Validation Report [D3], Table 5-3. Summary on the TCDR stability evaluation is given in CM SAF Validation Report [D3], Figure 5-8, page 24.

Achieved accuracy and stability fulfil the CM SAF product requirements [D4].

3.4 Surface Reflected Shortwave Radiation

Target requirements are not applicable for these products as they are directly derived from other products. All input products fulfil their corresponding target requirements. For this dataset, we provide an accuracy estimation using the error propagation method [D6]. We provide the most conservative accuracy estimation by assuming that the uncertainties in the input datasets align perfectly and fully contribute to the overall uncertainty.

3.5 Surface Net Shortwave Radiation

Same as 3.4

3.6 Surface Net Longwave Radiation

Same as 3.4

3.7 Surface Radiation Budget

Same as 3.4

4. Data usage information

4.1 Data format

Information on the file format for the data brokered from EUMETSAT’s CM SAF CLARA-A2.1 products is provided in CM SAF PUM Surface Radiation Products [D2], Section 4.1.

CLARA product family Global Surface Radiation Budget dataset from polar orbiting satellites is provided in NetCDF (Network Common Data Format) file format. The global attributes follow the Copernicus Common data Model (CDM) instructions [D5]. The metadata and naming definitions follow the Climate & Forecast (CF) conventions version 1-7 (https://cfconventions.org). The keywords follow GCMD Science Keywords (Global Change Master Directory), Version 8.1.

ICDR extensions of SOL and SDL and the extra data products data format and data file contents are made fully compatible with brokered CLARA-A2.1 products.

4.2 Product content and attributes

A description of the file contents of the brokered CLARA-A2.1 dataset in general is given in CM SAF PUM [D2], Section 4.1. Note that within the scope of this project, the brokered dataset exclusively comprises level-3 data on a global equal angle grid.

Each NetCDF file consists of dimensions, variables and attributes. All data files are built following the same design principles. Each data file contains the following coordinate and 3-dimensional variables:

-      Time

Start of averaging time period [days since 1970-01-01 00:00:00]

-      Latitude

Geographical latitude of grid-box centre [degrees_north]

-      Longitude

Geographical longitude of grid-box centre [degrees_east]

-      \( SIS,\ SDL,\ SOL,\ SRS,\ SNS,\ SNL,\ SRB \)

Parameter grid box mean value, name depends on the parameter

Global attributes are summarized in the Copernicus CDM [D5], Section 9.

ICDR extensions of SOL and SDL and the extra data products NetCDF file structure is fully compatible with brokered CLARA-A2.1 products.

4.3 User-relevant dataset characteristics

The product description in CM SAF ATBD [D1], Section 2.1.1.4 includes information on known limitations of the algorithm used to generate the SIS product and their implications.

The product description in CM SAF ATBD [D1], Section 2.2.1.3 includes information on known limitations of the algorithm used to generate the SDL product and their implications.

The product description in CM SAF ATBD [D1] Section 2.2.2.1 includes information on known limitations of the algorithm used to generate the SOL product and their implications.

CM SAF PUM [D2], Section 2.2 includes the general limitations on the application of the SIS, the SDL and the SOL products.

Known limitations of the algorithms and the general limitations apply to both TCDR and ICDR extensions of SOL and SDL

4.4 Disclaimer

The disclaimer outlined in CM SAF PUM [D2], Section 7 applies for all CM SAF brokered datasets.

Full licence text can be found in the Licence section of the landing page at the CDS-entry: Surface Radiation Budget derived from satellite observations https://cds.climate.copernicus.eu.

5. Data access information

The dataset is available in the C3S Climate Data Store (CDS, see Figure 1)

https://cds.climate.copernicus.eu/cdsapp#!/dataset/satellite-surface-radiation-budget?tab=overview

CLARA product family CDR is the part of the Surface Radiation Budget (SRB) Essential Climate Variable (ECV).

Figure 1: Copernicus CDS Landing Page.

5.1 Product ordering process

You need to be registered and logged in to order products in the CDS. A login is provided upon registration, all products in the CDS are delivered free of charge.

5.2 Visualization tool

The data may be visualized using the CDS Toolbox:

https://cds.climate.copernicus.eu/cdsapp#!/toolbox

References

References are listed in CM SAF ATBD [D1], Section 3, CM SAF Product User Manual [D2], Section 8 and CM SAF Validation Report [D3], Section 7.

This document has been produced in the context of the Copernicus Climate Change Service (C3S).

The activities leading to these results have been contracted by the European Centre for Medium-Range Weather Forecasts, operator of C3S on behalf of the European Union (Delegation agreement signed on 11/11/2014). All information in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular purpose.

The users thereof use the information at their sole risk and liability. For the avoidance of all doubt , the European Commission and the European Centre for Medium - Range Weather Forecasts have no liability in respect of this document, which is merely representing the author's view.

Related articles