Contributors: M. Pondrom (Deutscher Wetterdienst)
Issued by: Deutscher Wetterdienst (DWD) / Marc Pondrom
Date: 12/04/2024
Ref: C3S2_D312a_Lot1.3.2.9_202404_SQAD_DWD_PRC_GIRAFE_v1.1
Official reference number service contract: 2021/C3S2_312a_Lot1_DWD/SC1
|
|
|
|
| Figure 5-1: The schematic of Copernicus User Support (CUS Handbook, section 2) |
Table 1: Definition of various technical terms used in the document
| Jargon | Definition |
|---|---|
| Brokered product | The C3S Climate Data Store (CDS) provides both data produced specifically for C3S and so-called brokered products. The latter are existing products produced under an independent programme or project which are made available through the CDS. |
| Climate Data Store | The front-end and delivery mechanism for data made available through C3S. |
| TCDR | A Thematic Climate Data Record is a consistently-processed time series of a geophysical variable of sufficient length and quality. The term "TCDR" is used in the nomenclature of the original product under the EUMETSAT CM SAF program. |
| CDR | A Climate Data Record (CDR) is defined as a time series of measurements with sufficient length, consistency, and continuity to determine climate variability and change. The term "CDR" is used in the framework of the Copernicus Climate Change Service. |
| CM SAF Web User Interface (WUI) | Part of the EUMETSAT CM SAF website providing the service to download the products via an user-friendly interface. |
This document describes the systems used for delivering the Thematic Climate Data Record (TCDR) on Precipitation, brokered from EUMETSAT's CM SAF to the Climate Data Store (CDS) of the Copernicus Climate Change Service (C3S). Interfaces to external data and the interface to the CDS are outlined. Information about new data cycles is also provided in this document. Internal procedures for managing and communicating system maintenance and for user support are described.
The TCDR on the Essential Climate Variables (ECV) Precipitation is a brokered product of GIRAFE dataset to upgrade the Copernicus micrOwave-based gloBal pRecipitAtion (COBRA) product of the preceding phase of C3S. Within C3S, the datasets are made accessible to the CDS via the webserver hosted by DWD (https://c3s.satproj.klima.dwd.de/data/) and can be ordered via HTTP/HTTPS protocol. Login details are provided directly to the CDS team. Respective outages will be kept to a minimum and, whenever possible, communicated to C3S in advance. We provide user support for queries relating to our products when forwarded to us by C3S.
The GIRAFE TCDR has been produced and archived outside of this contract by EUMETSAT's CM SAF. Therefore, the interfaces for the delivering of data to C3S are described within this document. Detailed Information on the retrieval algorithm can be found in the CM SAF Algorithm Theoretical Basis Document (ATBD) [D1], details of the product can be found in the Product User Manual (PUM) [D2].
The GIRAFE dataset on Precipitation was downloaded via the CM SAF Web User Interface (https://wui.cmsaf.eu/safira/action/viewProduktSearch) and copied to the webserver hosted by DWD as a CDR product. It is brokered as a CDR into the C3S CDS.
The brokered GIRAFE product is made accessible via DWD's webserver at https://c3s.satproj.klima.dwd.de/data/. All data provided for the CDS by DWD will be uploaded to this server. It can be accessed via HTTP/HTTPS protocol. Exact addresses of the provided files will be provided to the CDS upon submission. This allows automated access to the files, e.g. via scripts handling the delivery chain of an order in the CDS from the server to the user. We aim for a 99% availability of the data server, with 95% of the data transactions happening at a rate of 10 Mbit/s or faster.
As mentioned previously, the GIRAFE dataset on Precipitation has been produced outside of this contract. The following describes the computing infrastructure used for storing and delivering the data to C3S.
The GIRAFE production system consists of two Multi-Node Batch Systems (MNBS); Login/Compute nodes are virtual Linux servers hosted by DWD. One MNBS is used for the processing of observations from microwave (MW) sensors on Low-Earth-Orbit (LEO) satellites, and the other for the processing of infrared (IR) images from geostationary (GEO) satellites as well as for GIRAFE processing algorithm. A workflow controller is used to realize task dependencies and submit multiple jobs in parallel to the computer nodes. Input and output data are read from and written to Network File System (NFS) storage. The dataset requires a total (LEO MW data + GEO IR data + ancillary data + GIRAFE products) storage capacity of 112 TB.
The Precipitation dataset brokered from EUMETSAT's CM SAF is not backed up within the framework of C3S, but in the case of data corruption or loss on the data server, which serves as interface to the CDS, it can be downloaded again from its original, dedicated source, where back-ups outside the C3S project responsibilities are maintained.
The first brokered edition of the GIRAFE Precipitation dataset (TCDR v1.0) covering the years 01/2002 - 12/2022 was delivered in 01/2024. Within the scope of this project, no ICDR for GIRAFE is foreseen. Therefore n/a.
Within the scope of this project, no reprocessing of the GIRAFE TCDR on precipitation is foreseen. Therefore n/a
In general, any issue with IT infrastructure that either delays delivery of data or impedes access to data via the CDS will be documented in the Quarterly Report.
This section discusses treatment of delays at interfaces to external data sources.
It is beyond the scope of our responsibility to safeguard the stability of services and data servers of external providers. If we become aware of issues at their end that will impede the timely delivery of brokered data, we will notify C3S.
This section discusses maintenance and outages of the data server hosting the files for access through the CDS.
Planned outages of the data server on which the CDS accesses the files are kept to a minimum. However, data transition and software updates may become necessary, or hardware may need to be maintained or replaced. Such planned outages will be communicated to the CDS as early as possible. Respective notifications will be issued by DWD's IT department and delivered to the DWD-based members of the Service Management Team of C3S2_312a_Lot1, who will ensure prompt passing on to the CDS. We do not expect to contact users of datasets submitted by us directly, but only through this communication to CDS.
We are open to request by C3S to schedule dates on which no planned maintenance involving an outage should be carried out. Although a respective commitment by the IT department cannot be guaranteed, we always strive to respect such requests.
Unexpected system outages will be treated according to internal regulations and procedures at DWD's IT department. This involves notification of the DWD-based members of the Service Management Team, who will in turn notify C3S of the outage as quickly as possible. The IT department will resolve the issue according to their procedures and notify C3S, again via the Service Management Team.
The user has the possibility to browse and search in the Copernicus Knowledge Base (CKB) or the Copernicus Climate Data Store desk. This is known as the level-0 process of User Support (Figure 5-1).
Figure 5-1: The schematic of Copernicus User Support (CUS Handbook, section 2)
Contact and User Support process on JIRA Service Desk
Once a request is sent, the Copernicus User Support (CUS) Service team at ECMWF will handle the request within 8 hours (level-1).
For any scientific and special enquiries that cannot be answered by the CUS team at ECMWF or addressed to the Knowledge Base, the request will be forwarded to the Copernicus User Support Specialists (level-2).
Enquiries forwarded to the Copernicus User Support Specialist team will be acknowledged within 3 working days (target 100%) and a notification sent to the user. In case of specific scientific issues, the enquiries will be channelled to the ECV and data specialist of the C3S2_312a_Lot1 project and should be resolved within 3 working weeks (target 85%). In each quarter, we aim for User Support satisfaction scoring 3 in 90% of all voluntary based feedbacks by users, with 1 (very unsatisfied) to 5 (very satisfied). We will also list the number of tickets in the Quarterly Report.
This document has been produced in the context of the Copernicus Climate Change Service (C3S). The activities leading to these results have been contracted by the European Centre for Medium-Range Weather Forecasts, operator of C3S on behalf of the European Union (Delegation Agreement signed on 11/11/2014 and Contribution Agreement signed on 22/07/2021). All information in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular purpose. The users thereof use the information at their sole risk and liability. For the avoidance of all doubt , the European Commission and the European Centre for Medium - Range Weather Forecasts have no liability in respect of this document, which is merely representing the author's view. |
Related articles appear here based on the labels you select. Click to edit the macro and add or change labels.