Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Page info
infoTypeModified date
dateFormatdd MMMM yyyy - HH:mm
prefixLast modified:
count1
page$self
typeFlat

Message Box
iconnone
titleShut down of legacy CDS - Please migrate to EWDS!
typeerror

The legacy CDS and legacy ADS will be decommissioned on 26 September 2024 and will no longer be accessible from this date. 

On 26 September 2024, CDS-Beta and ADS-Beta will officially become the new CDS and ADS, and EWDS-Beta will become operational for accessing CEMS data.

The URLs to CDS-Beta, ADS-Beta and EWDS-Beta will shift tocds.climate.copernicus.eu, ads.atmosphere.copernicus.eu and ewds.climate.copernicus.eu respectively. 

If you are a legacy CDS or legacy ADS user and wish to continue downloading data from our Data Stores, you are urged to migrate to the CDS-Beta, ADS-Beta, or EWDS-Beta now (see quick guides below). From September 26, 2024, CDS, ADS, and EWDS API users attempting to access data using their legacy credentials will see their requests systematically fail, for which no support will be provided.

If you are a CDS-beta, ADS-beta, or EWDS-beta user, from September 26, 2024, there is no urgency at this time to update the URL in your .cdsapirc. Requests will be automatically redirected from the beta URLs to the proper ones for some time. You will be advised to update the URL in your .cdsapirc file at your earliest convenience (but within a timeframe to be announced). We will update this page and post an announcement on our Forum to remind and guide users on what to do. 

The decommissioning date of 26 September 2024 is final and will not be extended. On 26/09/24, legacy systems will no longer be available to users. Queues on legacy systems will be closed on 25/09/24. API users on legacy systems who will not have migrated to beta systems will see their API requests fail. API users on Beta systems will have until 29/10/24 to update the URL in their cdsapirc file

...

Note
titleQuick Guide
  • Create a new EWDS-Beta account and accept EWDS-Beta Terms & Conditions at https://ewds-beta.climate.copernicus.eu/
  • Accept the licences of the product you are interested in (go to the Download form of the product of interest).
  • For API access:
    • Update API credentials and end point (eg. in your .cdsapirc file) as shown, after logging on here (Note that new .cdsapirc file should only contain a URL and a key field - there is NO UID field anymore).
    • Upgrade your CDS API (i.e pip install --upgrade cdsapi). Please make sure you are using a supported version of Python i.e. 3.8 and above
    • New API is designed to be backward compatible which means that once your .cdsapirc is updated and your CDS API package upgraded, your API script may run successfully immediately, downloading data from CDS-Beta. There are a few datasets however for which API syntax may have changed - please check the warning on the catalogue page of the affected datasets (e.g. E-OBS). 
    • Run a small API test request. 

More details available (e.g. CDS Toolbox and Good-to-know sections below)

Table of Contents

Introduction 

A new state-of-the-art infrastructure, referred to as the Common Data Store Engine, has been developed by ECMWF to host the Climate and Atmospheric Data Stores.  All layers of the infrastructure are being modernised: the front-end web interface, the back-end software engine, and the underlying cloud infrastructure hosting the service and core data repositories.

Message Box
iconnone
titleNew CEMS Early Warning Data Store
typegeneric

As part of this development, a new data store for the Copernicus Emergency Management Service has been created. The CEMS Early Warning Data Store (EWDS) will host all the historical and forecast information for floods and forest fires at European and Global levels. CEMS datasets will be migrated to the EWDS, so users are encouraged to download and test data from the new EWDS Beta before the system becomes operational from 03 26 September 2024.


The new CEMS Early Warning Data Store Beta (EWDS Beta) is now live for testing!
https://ewds-beta.climate.copernicus.eu/

...

The CDS Toolbox will be discontinued  and is not migrated from 26 September 2024 and will not migrate to the new CDS/EWDS infrastructure. Support will continue to be provided to CDS Toolbox users until the CDS Toolbox is shut down in on 26 September 2024. ECMWF Support will however not be able to help with supporting users migrating their CDS Toolbox workflows onto another programming language/software. On 26/09/24, legacy systems will no longer be available to users. Queues on legacy systems will be closed on 25/09/24. API users on legacy systems who will not have migrated to beta systems will see their API requests fail. API users on Beta systems will have until 29/10/24 to update the URL in their cdsapirc file

As a consequence of the CDS Toolbox being discontinued, the Viewer tool for the following datasets in the CDS will also be discontinued. 

...

All Climate Data Store Applications will also be retired and no longer available when the current Climate Data Store is shut down in on 26 September 2024.

CDS-Beta will have some better performing applications including the Copernicus Interactive Climate Atlas and Climate Pulse. More applications will be published including new versions of some applications in the legacy CDS e.g. ERA5 explorer, Global temperature trend monitor...


IP address range for CDS-beta/ADS-beta/EWDS-beta

CDS/ADS/EWDS Download servers are all still under the same IP range. In the CDS-Beta, IP address ranges are: 

136.156.136.0/21

136.156.128.0/21

...

  • New publication of datasets (including publication of existing dataset new versions) will only be made in the new CDS/ADS/EWDS infrastructure. Users are therefore urged to migrate over to the new CDS/ADS/EWDS infrastructure as soon as possible.
  • Some observation datasets will not be immediately available to download from the new CDS infrastructure while technical issues with these particular datasets are being addressed. Please see this page for details. 
  • Some unsupported datasets in the current CDS will be deprecated in the new CDS/ADS/EWDS infrastructure.
  • A new GRIB to NetCDF convertor converter has been implemented in CDS/EWDS-Beta. Further details to be provided soonPlease refer to our forum announcement.
  • Updates to the EWDS documentation on the CEMS-Flood/CEMS-Fire wiki pages are ongoing as the implementation occurs. Scripts and examples on these pages are under review and may not be fully functional yet for the EWDS, so please be patient.
  • For the time being, DOIs of datasets in CDS-Beta will point to the same datasets in the current CDS until the current CDS is shut down in on 26 September 2024.
  • The current CDS and ADS will be completely shut down in on 26 September 2024Please migrate to using the new CDS/ADS/EWDS by 26 September 16th, 2024. Should users still have API scripts pointing to the retired CDS and ADS systems, these will systematically break and no support will be provided. On 26/09/24, legacy systems will no longer be available to users. Queues on legacy systems will be closed on 25/09/24. API users on legacy systems who will not have migrated to beta systems will see their API requests fail. API users on Beta systems will have until 29/10/24 to update the URL in their cdsapirc file
  • For more information on specific changes to the CDS and ADS systems, visit: Informative page in readiness for CDS-Beta

...