...
| Message Box | ||||||
|---|---|---|---|---|---|---|
| ||||||
The legacy CDS and legacy ADS will be systems were decommissioned on 26 September 2024 and will are no longer be accessible from this date. On 26 September 2024, CDS-Beta and ADS-Beta will officially become the new CDS and ADS, and EWDS -Beta will become operational for accessing CEMS data. The URLs to CDS-Beta, ADS-Beta and EWDS-Beta will automatically shift tocds.climate.copernicus.eu, ads.atmosphere.copernicus.eu and ewds.climate.copernicus.eu respectively. If you are a legacy CDS or legacy ADS user and wish to continue downloading data from our Data Stores, you are urged to migrate to the CDS-Beta, ADS-Beta, or EWDS -Beta now (see quick guides below). From 26 September 26, 2024, CDS, ADS, and EWDS API users attempting to access data using their legacy credentials will see their requests systematically systematically fail, for which no support will be provided. If you are a CDS-beta, ADS-beta, or EWDS-beta user, from 26 September 26, 2024, there is no is no urgency at this time to update the URL in your .cdsapirc. Requests will be automatically redirected from the beta URLs to the proper ones operational URLs for some time. You will be advised to update the URL in your .cdsapirc file at your earliest convenience (but within a timeframe to be announced). We will update this page and post an announcement on our Forum to remind and guide users on what to do. The decommissioning date of 26 September 2024 is final and will not be extended. On 26/09/24From 26 September 2024, legacy systems will no longer be available to users. Queues on legacy systems will be closed on 25/09/24. API users on legacy systems who will not have migrated to beta systems will see their API requests fail. API users on Beta systems will have until 29/10/24 to update the URL in their cdsapirc file |
| Note | ||
|---|---|---|
| ||
More details available (e.g. CDS Toolbox and Good-to-know sections below) |
| Table of Contents |
|---|
Introduction
A new state-of-the-art infrastructure, referred to as the Common Data Store Engine, has been developed by ECMWF to host the Climate and Atmospheric Data Stores. All layers of the infrastructure are being modernised: the front-end web interface, the back-end software engine, and the underlying cloud infrastructure hosting the service and core data repositories.
| Message Box | ||||||
|---|---|---|---|---|---|---|
| ||||||
As part of this development, a new data store for the Copernicus Emergency Management Service has been created. The CEMS Early Warning Data Store (EWDS) will host all the historical and forecast information for floods and forest fires at European and Global levels. CEMS datasets will be have been migrated to the EWDS, so users are encouraged to download and test data from the new EWDS Beta before the system becomes operational from 26 September 2024and are no longer available from the Climate Data Store (CDS). The new CEMS Early Warning Data Store Beta (EWDS Beta) is now live for testing! |
The modernisation of the Data Stores is a journey on which we embarked for the users and with the users. Without your support and your collaboration, this transition would simply not be achievable. We thank you all again for your patience during this significant modernisation of our Data Stores and eagerly await for your constructive feedback via our Support Portal!
What does this mean in practice to current CDS (and ADS) users?
User account:
ECMWF Single Sign-On (SSO) has been extended to all its platforms including the new CDS, ADS, and EWDS. SSO allows users to have access to multiple applications by signing in with only one account. It also has other important features in regard to simple management, security, ease of use, and seamlessness.
...
| Warning |
|---|
Your ECMWF account will only allow you to login to the new CDS/ADS/EWDS, not onto the current CDS/ADS. You cannot use your ECMWF account to log in onto the current CDS or current ADS. SSO does not apply to current CDS nor current ADS. Your existing CDS account will only work in the current CDS, not in EWDS Beta. You need an ECMWF account to start using EWDS. From 26 September 2024, all CEMS data is solely accessible from the EWDS – legacy CDS and CDS-Beta systems no longer host CEMS datasets. |
CDS/ADS/EWDS Catalogue - data download over web interface:
- Before downloading any data from the new CDS/ADS/EWDS infrastructure, users will have to accept dataset licences on the new system. Users' profiles including licensing information are not being transferred. In practical terms, this means for example that if you are downloading ERA5 data (web or API) from the current CDS, you will need to login to the new CDS and accept the terms and conditions for ERA5 (i.e. Licence to use Copernicus Products). You can check whether you have accepted the dataset licence under Your Profile on new CDS-Beta /EWDS systems (see Dataset Licences section below the Terms & Conditions).
API Service - programmatic way of downloading data:
- A new version of the cdsapi package has been released. API users need to upgrade their CDS API (i.e pip install --upgrade cdsapi). Note that the new version of the cdsapi package works on both the current and new CDS.
- Log in to the EW- DS Beta EWDS interface using your ECMWF account and follow the instructions online. Make sure you also accept the Terms and Conditions of the datasets you wish to download (this is the dataset licence in addition to the Terms & Conditions for using EWDS Beta - see CDS/ADS/EWDS Catalogue section above).
- Before submitting your API request, you will need to update your .cdsapirc file as shown in the first black box displayed on the EWDS Beta API page (you must be logged in!). Note that new .cdsapirc file should only contain a URL and a key field - there is NO UID field anymore)
- While the new API is designed to be backward compatible, we strongly recommend you please use the "Show API request code" tool on the dataset Download Form on EWDS Beta to check you are using the correct syntax for your API request. CDS/ADS/EWDS API syntax is changed and some keys or parameter names may have also changed for some datasets (e.g. E-OBS).
CDS Toolbox, Viewers and Applications:
The CDS Toolbox will be has been discontinued from 26 September 2024 2024 and will not migrate be migrated to the new CDS/EWDS infrastructure. Support will continue to be provided to CDS Toolbox users until the CDS Toolbox is shut down on 26 September 2024. ECMWF Support will however not be able to help with supporting users migrating their CDS Toolbox workflows onto another programming language/software. On 26/09/24, legacy systems will no longer be available to users. Queues on legacy systems will be closed on 25/09/24. API users on legacy systems who will not have migrated to beta new systems will see their API requests fail. API users on Beta systems will have until 29/10/24 to update the URL in their cdsapirc file
...
All Climate Data Store Applications will also be retired and no longer available when the current Climate Data Store is shut down on 26 September 2024.
The new CDS -Beta will have some better-performing applications including the Copernicus Interactive Climate Atlas and Climate Pulse. More applications will be published including new versions of some applications in the legacy CDS e.g. ERA5 explorer, Global temperature trend monitor...
IP address range for CDS-beta/ADS-beta/EWDS-beta
CDS/ADS/EWDS Download servers are all still under the same IP range.
136.156.136.0/21
136.156.128.0/21
Feedback and reporting bugs/issues:
Please send your feedback and/or report any issue/bug you may have encountered while using the new CDS/ADS/EWDS infrastructure by raising an enquiry ticket through our dedicated Support Portal (ECMWF login required) - make sure you select "Yes" to the question Is this request related to CDS-beta/ADS-beta/CEMS-EW-beta? on the Support Portal request form - this will help the Support team with triaging enquiries more efficiently.
Good to know
- New publication of datasets (including publication of existing dataset new versions) will only be made in the new CDS/ADS/EWDS infrastructure. Users are therefore urged to migrate over to the new CDS/ADS/EWDS infrastructure as soon as possible.
- Some observation datasets will not be immediately available to download from the new CDS infrastructure while technical issues with these particular datasets are being addressed. Please see this page for details.
- Some unsupported datasets in the current CDS will be deprecated in the new CDS/ADS/EWDS infrastructure.
- A new GRIB to NetCDF converter has been implemented in the new CDS/EWDS -Betasystems. Please refer to our forum announcement.
- Updates to the EWDS documentation on the CEMS-Flood/CEMS-Fire wiki pages are ongoing as the implementation occurs. Scripts and examples on these pages are under review and may not be fully functional yet for the EWDS, so please be patient.
- For the time being, DOIs of datasets in CDS-Beta will point to the same datasets in the current CDS until the current CDS is shut down on 26 September 2024.
...