Contributors: A. Velazquez Blazquez (Royal Meteorological Institute of Belgium (RMIB)), N. Clerbaux (RMIB), E. Baudrez (RMIB)
Issued by: RIB
Date: 08/07/2021
Ref: C3S_D312b_Lot1.2.5.4-v1.0_201903_SQAD_ECVEarthRadiationBudget_v1.1
Official reference number service contract: 2018/C3S_312b_Lot1_DWD/SC1
History of modifications
List of datasets covered by this document
Related documents
Acronyms
General definitions
Scope of the document
This document describes the systems that are used for brokering the HIRS OLR CDR data from NOAA/NCEI to the Copernicus Climate Change Service (C3S) Climate Data Store (CDS). It also provides information on the procedures used in the event of problems or outages in the systems, whether planned or unplanned, and information on the provision of user support.
Executive summary
The NOAA/NCEI, the producer of the HIRS OLR data, provides the following executive summary for this CDR: This Climate Data Record (CDR) of monthly mean Outgoing Longwave Radiation (OLR) flux at the top of the atmosphere in all sky conditions is on a 2.5 degree x 2.5 degree grid with global coverage from January 1979 to the present and continuing monthly. It is derived based on the multispectral High Resolution Infrared Radiation Sounder (HIRS) OLR algorithm and other methodologies. This dataset was created from HIRS OLR retrievals from TIROS-N to NOAA-19, and MetOp-A/B satellites with inter-satellite calibration adjustments and employed the empirical diurnal model for monthly mean derivation. This version 2.7 is an upgrade from the previous version 2.2-1. The main change is in the OLR regression models and the inter-satellite calibration. The version 2.7 OLR regression models improved the retrieval consistency between variant versions of HIRS instruments, HIRS-2, 2i, 3 and 4, and in turn, the accuracy of inter-satellite calibration is significantly improved, thus eliminating the spurious trends presented in the version 2.2-1 data. The data file format is netCDF-4 with CF metadata, and it is accompanied by algorithm documentation, data flow diagram and source code for the NOAA CDR Program.
This version (v02r07 or simply "2.7") of the OLR-monthly CDR has been released on 31/08/2018, and new data have been added since then. Now it contains more than 40 years of satellite-based measurements of OLR, on a global scale with a 2.5° x 2.5° spatial resolution. The HIRS OLR CDR v02r07 is made available to the C3S Climate Data Store through an OPeNDAP server hosted by the NOAA at:
https://www.ncei.noaa.gov/thredds/dodsC/cdr/olr-monthly/olr-monthly_v02r07_197901_202002.nc.html
In this delivery, the HIRS OLR record contains data from January 1979 to February 2019. The file is accessed via OPeNDAP (or http).
Currently, no mirror (backup) is available in case of unavailability of the NOAA/NCEI OPeNDAP server. A local copy exists at RMIB and could be used in case of significant problems with the NOAA OPeNDAP distribution. In the case of unforeseen system failures, or other problems affecting data delivery through the OPeNDAP server, the CDS will be notified as quickly as possible, following any notification procedures requested by the CDS.
Back-end user support is provided by a point of contact at RMIB (Dr. Nicolas Clerbaux), ensuring a response to product related user queries within the allocated time frame and meeting the relevant Key Performance Indicator (KPI) targets.
1. System overview
1.1 System elements and interfaces
The HIRS OLR CDR is generated and archived outside of this contract by the NOAA/NCEI. Hence, this section only describes the interfaces for delivering the data to the C3S CDS. The C3S CDS can access the gridded monthly mean OLR via the NOAA/NCEI OPeNDAP server at:
https://www.ncei.noaa.gov/thredds/dodsC/cdr/olr-monthly/olr-monthly_v02r07_197901_202002.nc.html
This data server allows users to directly browse and subset data products, and provides additional functionalities such as accessing file contents directly via the internet from data processing scripts. The latter functionality is intended for use by the C3S CDS and similar services working in pull mode.
1.2 Hardware and data server system
As said, the HIRS OLR CDR is generated and distributed outside of this contract. For this reason, the computer infrastructure for generating and storing the data is not described in this SQAD.
The distribution to the NOAA/NCEI CDRs is performed via the NOAA/NCEI OPeNDAP server which runs the THREDDS Data Server [Version 4.6.11 - 2017-12-04T16:22:46-0700] software providing OPeNDAP server functionality. This server is accessed via:
https://www.ncei.noaa.gov/thredds/
1.3 Documentation
NOAA/NCEI documents and URLs
|
Lee, H.-T., 2018: Quality Assurance Results and Summary for Monthly and Daily OLR CDR (rev.20180831) [D6] http://olr.umd.edu/References/QA_Summary_OLR-Monthly_and_Daily_CDR_20180831.pdf |
Climate Algorithm Theoretical Basis Document (C-ATBD) for Monthly OLR CDR v02r07 [D2] |
Read me for Daily OLR CDR v01r02 http://olr.umd.edu/References/Read%20me%20for%20Daily%20OLR%20CDR%20v01r02.txt |
Copernicus Climate Data Store documents
|
C3S Product User Guide and Specifications ‑ Earth Radiation Budget HIRS OLR TCDR [D1] C3S_D312b_Lot1.3.8.2_201903_PUGS_v1.0 |
C3S Algorithm Theoretical Basis Document ‑ Earth Radiation Budget HIRS OLR TCDR [D5] C3S_D312b_Lot1.1.5.2_201903_ATBD_v1.0 |
C3S Product Quality Assurance Document ‑ Earth Radiation Budget HIRS OLR TCDR [D4] C3S_D312b_Lot1.2.5.5_201903_PQAD_v1.0 |
Copernicus User Support Handbook, V2.1 [D3] ftp://ftp.ecmwf.int/pub/copsup/CUS-Agent-Training/Guides/CUS_Handbook_V2.1.pdf |
Relevant scientific papers
|
Lee, H.-T., A. Gruber, R. G. Ellingson and I. Laszlo, 2007: Development of the HIRS Outgoing Longwave Radiation climate data set. J. Atmos. Ocean. Tech., 24, 2029–2047. http://olr.umd.edu/References/Lee_et_al_2007_HIRS_OLR_CDR.pdf |
Schreck, C. J., H.-T. Lee and K. Knapp, 2018: HIRS Outgoing Longwave Radiation—Daily Climate Data Record: Application toward Identifying Tropical Subseasonal Variability. Remote Sens. 2018, 10, 1325 |
Lee, H.-T., 2014: Daily OLR CDR – Development and Evaluation. CERES Science Team Meeting, Apr 2014 |
Lee, H.-T., 2014: Daily OLR Climate Data Record. EGU General Assembly, Apr 2014 http://olr.umd.edu/References/Lee_2014_Daily_OLR_Climate_Data_Record_EGU_Apr2014.pdf |
Lee, H.-T., C. J. Schreck, and K. R. Knapp, 2014: Generation of Daily OLR CDR. Eumetsat Meteorological Satellite Conference, Sep 2014 http://olr.umd.edu/References/Lee_2014_Generation_of_Daily_OLR_CDR_Eumetsat_Sep2014.pdf |
2. Upgrade cycle implementation procedure
The CDR data products are brokered from external sources (the NOAA/NCEI team) and released as a single delivery. Therefore, this section is not applicable.
3. Procedures for reprocessing CDR's
The CDR data products are brokered from external sources (the NOAA/NCEI team) and released as a single delivery. Therefore, this section is not applicable.
4. System maintenance and system failures
The data products brokered from the NOAA/NCEI are served to the C3S CDS (pull mode) from an OPeNDAP server hosted by NOAA/NCEI: https://www.ncei.noaa.gov/thredds
The planned outages of the server, and therefore the availability of data, will be communicated as far as possible to the CDS well in advance. Any notification procedures requested by the CDS will be complied with.
The server is monitored by the RMIB in the frame of the C3S 312B Lot1 contract. In the case of unforeseen system failures, or other problems affecting data delivery through the OPeNDAP server, the CDS will be notified as quickly as possible, following any notification procedures requested by the CDS. For longer outages (longer than a few hours) the CDS will be notified again once the issue has been resolved.
Issues or outages, whether planned or unplanned, will be documented in the Quarterly Report.
5. User support
The point of contact will ensure that each product related user query is redirected (internally at RMIB and RAL or, externally, to the Dr. Hai-Tien Lee, Principal Investigator for this climate data record) to the most appropriate science team member for the formulation of a response. The response will then be delivered to the user within the allocated time frame. Throughout the process, the point of contact will ensure that the relevant key performance indicator (KPI) targets are met, and that the information collected from the science team will be used to develop the user knowledge base (via user documentation, FAQs, and user guides).
5.1 Enquiries
The user (customer) has the possibility to browse and search in the Copernicus Knowledge Base on Copernicus Climate Data Store desk. This is the level-0 process of User Support.
Figure 1: The schematic of Copernicus User Support (CUS Handbook V2 [D3]).
5.2 Contact and User Support process on JIRA Service Desk
Once a request is sent, the Copernicus User Support (CUS) Service team at ECMWF will handle the requests within 8 hours (level-1).
For any scientific and special enquiries that cannot be answered by the CUS team at ECMWF or addressed to the Knowledge Base, the request will be forwarded to the Copernicus User Support Specialists (level-2) to the following email address:
contact.c3s312b@dwd.de
Enquiries forwarded to the Copernicus User Support Specialist team at DWD will be acknowledged within 3 working days (target 100%) and a notification sent to the user. This step is proceeded on the JIRA JIRA : Project management software tool created by Atlassian company. Service Desk established at ECMWF for the current project. In case of specific scientific issues, the enquiries will be channeled to the data specialist of the C3S_312b_Lot1 project and should be resolved within 3 working weeks (target 85%). In case of brokered datasets, the data specialist may choose to contact the responsible team at the provider level if they cannot resolve the issue on their own. In each quarter, we aim for User Support satisfaction scoring 3 in 90% of all voluntary based feedbacks by users, with "1" (very unsatisfied) to "5" (very satisfied). We will also list the number of tickets in the Quarterly Report.
5.3 Service availability
User support and system maintenance will be usually available only during regular working hours in Germany, i.e. Monday–Friday, 9:00–17:00 CET, respectively, excluding public holidays.
