Page History

Introduction 

A new Climate Data Store (CDS) and a new Atmosphere Data Store (ADS) powered by a new state-of-the-art infrastructure, referred to as the Common Data Store (CDS) Engine are now open!

CDS-Beta:  https://cds-beta.climate.copernicus.eu/          and         ADS-Beta:   https://ads-beta.atmosphere.copernicus.eu/

All layers of the CDS an ADS infrastructure are being modernised: the front-end web interface, the back-end software engine and the underlying cloud infrastructure hosting the service and core data repositories. The modernisation of the Climate Data Store is a journey on which we embarked for the users and with the users. Without your support and your collaboration, this transition would simply not be achievable. We thank you all again for your patience during this significant modernisation of our Data Stores and eagerly await for your constructive feedback via our Support Portal!

Please watch our User Forum for further announcements!

What does this mean in practice to

legacy CDS and ADS users?

User account:

ECMWF Single Sign-On (SSO) has been extended to all its platforms including the new CDS and ADS. SSO allows users to have access to multiple applications by signing in with only one account. It also has other important features in regard to simple management, security, ease of use, and seamlessness.

All users of the new CDS and new ADS will need an ECMWF account. If you already have one, great. If you do not yet have an ECMWF account, please register with ECMWF to get one.

As a consequence of the single sign-on implementation, your current legacy CDS or ADS login credentials will not work on the new CDS or ADS, regardless of whether you are currently using the CDS or ADS interactively (e.g. over the web interface) or programmatically (using the API service). A new UserID (ECMWF) and API key will be needed.

CDS/ADS Catalogue - data download over web interface: 

• Before downloading any data from the new CDS or ADS, users will have to accept dataset licences on the new system. Users' profiles including licensing information are not being transferred. In practical terms, this means for example that if you are downloading ERA5 data (web or API) from the current CDS, you will need to login to the new CDS and accept the terms and conditions for ERA5 on the dataset Download form (i.e. Licence to use Copernicus Products). Similarly for ADS users, if you are downloading EAC4 data (web or API) from the current ADS, you will need to login to the new ADS and accept the terms and conditions for EAC4 (i.e. Licence to use Copernicus Products).
• You can check whether you have accepted the dataset licence under Your Profile on the New CDS-Beta or Your Profile on the new ADS-Beta (see Dataset Licences section below the Terms & Conditions).

• NOT TO BE ADDED YET: when current CDS shuts down, url of cds-beta will become cds again. Bookmarks will need to be updated but for the .cdsapirc file, users won't need to update the URL in a hurry as both cds-beta and cds urls will continue to work for a little longer (to give users time to switch url again). In due time, we will ask users to update the URL in their .cdsapirc until a date is fixed when cds-beta dns is closed.

API Service - programmatic way of downloading data from all Data Stores (new CDS

/new ADS

): 

• A new version of the cdsapi package has been released for programmatically retrieving data from both the new CDS -Beta and the new ADS-Beta. API users need to upgrade their CDS API (i.e e pip install --upgrade cdsapi). Note that the new version of the cdsapi package works on both the current and new CDS/ADS. 
• Check you are using a supported version of Python i.e. 3.8 and above. 
• Login to the new CDS -beta or the new ADS -Beta interface using your ECMWF account and follow the instructions online. Make sure you also accept the Terms and Conditions of the datasets you wish to download (this is the dataset licence in addition to the Terms & Conditions for using CDS-Beta/ADS - Beta - see CDS/ADS Catalogue section above).
• Before submitting your API request, you will need to update your .cdsapirc file as follows:
  • To retrieve data from new CDS-Beta: copy & paste the content of the first black box displayed on the CDS -Beta API page (you must be logged in!). Note that new .cdsapirc file should only contain a URL and a key field - there is NO UID field anymore)
  • To retrieve data from new ADS-Beta: copy & paste the content of the first black box displayed on the ADS -Beta API page (you must be logged in!). Note that new .cdsapirc file should only contain a URL and a key field - there is NO UID field anymore)
• While the new API is designed to be backward compatible on both new CDS -Beta and new ADS-Beta, we strongly recommend you use the "Show API request code" tool on the dataset Download Form on new CDS -beta or new ADS -Beta to check you are using the correct syntax for your API request. CDS API syntax is changed and some keys or parameter names may have also changed for some new CDS -Beta datasets (e.g. E-OBS).

Legacy CDS Toolbox, Viewers and Applications:

The  Legacy CDS Toolbox will be has been discontinued from 26  26 September 2024 and is not migrated to the new CDS. Support will continue to be provided to CDS Toolbox users until the CDS Toolbox is shutdown on 26th September 2024. ECMWF Support will however not be able to help with supporting users migrating their CDS Toolbox workflows on to another programming language/software. 

As a consequence of the CDS Toolbox being discontinued, the Viewer tool for the following datasets in the legacy CDS will have also be been discontinued. 

New tool packages will be made available to provide software tools for weather and climate workflows that simplify data access, analysis, visualisation and much more. Please watch the user forum for announcements on this topic in the next coming months.

All Climate Data Store Applications will also be retired and no longer available when the current Climate Data Store is shutdown on 26th September 2024.

have been retired. The new CDS will have some better performing applications including the Copernicus Interactive Climate Atlas and Climate Pulse. More applications will be published including new versions of some applications in the legacy CDS e.g. ERA5 explorer, Global temperature trend monitor...

IP address range for new CDS

and new ADS

CDS and ADS Download servers are all still under the same IP range. 

136.156.136.0/21

136.156.128.0/21

Feedback and reporting bugs/issues:

Please send your feedback and/or report any issue/bug you may have encountered while using the new CDS and ADS by raising an enquiry ticket through our dedicated  Support Portal (ECMWF login required) - make sure you select "Yes" to the question Is this request related to CDS-beta/ADS-beta/CEMS-EW-beta? on the Support Portal request form - this will help the Support team with triaging enquiries more efficiently.

Good to know

• New publication of datasets (including publication of existing dataset new versions) will only be made in the new CDS/ADS. Users are therefore urged to migrate over to the new CDS/ADS as soon as possible.
• Some observation datasets will not be are immediately available to download from the new CDS while technical issues with these particular datasets are being addressed.

• Expand

  In situ temperature, relative humidity and wind profiles from 2006 to March 2020 from the GRUAN reference network In situ total column ozone and ozone soundings from 1924 to present from the World Ozone and Ultraviolet Radiation Data Centre In situ observations of meteorological variables from the Integrated Global Radiosounding Archive and the Radiosounding Harmonization dataset from 1978 onward In-situ observations of water vapour and atmospheric delay from the ground-based GNSS network from 1996 to present

• Some unsupported datasets in current legacy CDS will be have been deprecated in the new CDS. 

• Expand

  Arctic route availability and cost projection derived from climate projections of ice concentration and thickness Ship performance along standard shipping routes derived from reanalysis and seasonal forecasts Water level change time series for the European coast from 1977 to 2100 derived from climate projections Water level change indicators for the European coast from 1977 to 2100 derived from climate projections Performance indicators for offshore wind farms in Europe from 1977 to 2100 derived from climate projections Soil erosion indicators for Italy from 1981 to 2080 Flood risk indicators for European cities from 1989 to 2018 Water sector indicators of hydrological change across Europe from 2011 to 2095 derived from climate simulations Ocean fronts data for the Northwest European Shelf and Mediterranean Sea from 1991 up to 2100 Eutrophication indicators for the Northwest European Shelf and Mediterranean Sea from 2006 up to 2100 Fish abundance and catch data for the Northwest European Shelf and Mediterranean Sea from 2006 to 2098 derived from climate projections Climate suitability indicators for tourism from 1970 to 2100 over Europe derived from climate projections Climate variables for cities in Europe from 2008 to 2017 Sea level daily gridded data from satellite observations for the Mediterranean Sea from 1993 to 2020 2020  Sea level daily gridded data from satellite observations for the Black Sea from 1993 to 2020 2020

• A new GRIB to NetCDF convertor has been implemented in both the new CDS -Beta and the new ADS-Beta. Please refer to our Forum announcement.
• For the time being, DOIs of datasets in CDS-Beta will point to the same datasets in current CDS until current CDS is shutdown on 26th September 2024.
• The current CDS and ADS will be completely shutdown on 26th September 2024. Please migrate to using the new CDS/ADS by September 26th, 2024. Should users still have API scripts pointing to the retired CDS and ADS systems, these will systematically break and no support will be provided.this page for more information: https://confluence.ecmwf.int/x/uhDeGg

_{This document has been produced in the context of the Copernicus Atmosphere Monitoring Service (CAMS) and Copernicus Climate Change Service (C3S).}

_{The activities leading to these results have been contracted by the European Centre for Medium-Range Weather Forecasts, operator of CAMS and C3S on behalf of the European Union (Delegation Agreement signed on 11/11/2014 and Contribution Agreement signed on 22/07/2021). All information in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular purpose.}

 _{The users thereof use the information at their sole risk and liability. For the avoidance of all doubt , the European Commission and the European Centre for Medium - Range Weather Forecasts have no liability in respect of this document, which is merely representing the author's view.}

Related articles