The European Centre for Medium-Range Weather Forecasts (ECMWF) operates Data Store Service (DSS) as a family of common architecture data stores, such as the Climate Data Store (CDS), Atmosphere Data Store (ADS), Early Warning Data Store (EWDS), etc. To this effect, the DSS provides access to the data products produced and brokered as part of, the Copernicus Climate Change Service (C3S), the Copernicus Atmospheric Monitoring Service (CAMS), the Copernicus Emergency Management Service (CEMS) and internally produced ECMWF data products. In addition to the data access, the ECMWF provides a separate JupyterHub service for the DSS (DSS JupyterHub Service), by means of which DSS users can have interactive compute sessions on DSS compute infrastructure, typically associated with Python ¹  Notebooks, but also compatible with standard Python scripts and bash scripts.

Use of the ECMWF DSS JupyterHub Service is regulated by these Terms of Use. For avoidance of doubt, by using the DSS JupyterHub Service the DDS user agrees to be bound to all terms and conditions provided in these Terms of Use. If a DSS user is agreeing to these Terms of Use on behalf of an organisation, company or other legal entity, such DSS user represents that they have the legal authority to bind that organisation, company or legal entity to these Terms of Use.  To the same effect, the use of one account to access DSS JupyterHub Service by a number of DDS users constitutes an agreement with these Terms of Use by each one of these different DDS users.

These Terms of Use are in addition to any terms and conditions associated with the use of the respective data store and the data, associated products and services from such a data store.

Subject of the Terms of Use

Jupyter ² is a multi-user notebook server, which gives users access to computational environments and resources without the need for any installation and maintenance tasks by the users.

The use of JupyterHub in DSS is to enable the deployment of compute sessions to DSS users based on availability. These sessions provide fast access to the data available on the various data stores and allow DSS users to perform post-processing and visualisation of this data. These sessions are not designed for very large computations ³ .

The use of JupyterHub in DSS as described in these Terms of Use is hereinafter referred to as ‘DSS JupyterHub Service’.

Registration

DSS JupyterHub Service is available to all DSS users registered with the respective data store, serviced by DSS. No additional registration is needed.

Access

DSS JupyterHub Service is available from the ECMWF JupyterHub launcher page, linked from the respective data store web site. Access requires ECMWF log- in credentials, including a two-factor authentication.

Once logged in, DSS users have a choice of environment to use for their DSS JupyterHub Service session, as described below in Article (4) Description of the Service.

DSS JupyterHub Service may be unavailable from time to time for scheduled maintenance or due to unforeseen circumstances. Furthermore, during busy periods DSS users may have to wait for resources to become available before a session is allocated.

Description of the Service

For a full description of the DSS JupyterHub Service please refer to the JupyterHub for the ECMWF Data Store Service (DSS) description page. For the purposes of these Terms of Use, the below shall be explicitly noted as applicable to the DSS JupyterHub Service:

Available Environments

DSS users are able to spawn sessions with one of the environments summarised in the Environments available to DSS users section n the service description page.

To ensure fair usage of CDS and CDS JupyterHub Service ECMWF reserves the right to prioritise smaller (and shorter) sessions before others.

Pre-installed Software

The default Python environment is created using conda-forge with the following environment.yml file described Pre-installed software section of the service description page.

DSS users can install additional packages from the (open-source) conda-forge channel (`conda install PACKAGE-NAME`), or from PyPi (`pip install PACKAGE-NAME`). These packages will be installed in the DSS user’s local storage and will be available next time the DSS user creates a session.

User Storage

DSS JupyterHub Service is provided with two forms of storage: Private and Scratch, as described below.

Private Storage

Each DSS user has 1Gb Private Storage allocation, which is accessible only to the given DSS user.  

If a Private Storage is not accessed (i.e. by spawning a session) for a period of thirty-one (31) consecutive days, this Private Storage together with its contents may be deleted in its entirety.

Scratch Storage

Each DSS user will have a Scratch Storage, which represents 100Gb maximum quota per each DSS user on a temporary scratch disk. If the individual quota be exceeded, automated scripts will delete the oldest files (in terms of access time) until the quota is no longer exceeded.

Should the individual circumvent the quota, in addition to any other rights available under these Terms of Use, ECMWF reserves the right to delete any files stored in the Scratch Storage of the DSS user.

The purpose of the Scratch Storage is to store files for a current session or several sessions and such files shall not be considered permanently stored. The Scratch Storage is mounted on a shared disk and is cleaned regularly to ensure that the disk does not exceed capacity. Therefore, the lifetime of the storage of files in the Scratch Storage depends on the overall usage of the DSS JupyterHub Service by all DSS users. The cleanup of files is based on the least recently accessed files.

Shared Resources

There is a shared resources directory available for the CDS JupyterHub Service. This shared resources directory is ‘read only’ and contains resources provided by Copernicus Climate Change (C3S) and Copernicus Atmospheric Monitoring (CAMS) services and ECMWF, including but not limited, the notebooks found in the C3S training material.

External Network Access

For security reasons secure shell (SSH) protocol connections are disabled with respect to the DSS JupyterHub Service. 

DSS users can use the hypertext transfer protocol secure (HTTPS) address for access repositories outside DSS and/or the DSS JupyterHub Service given they are not forbidden by the ECMWF firewall.

Technical and Security Requirements

DSS users are responsible for all activities that occur under their account and shall ensure that their content or service will not violate any applicable law. The DSS users are responsible for properly using the DSS JupyterHub Service to secure, protect and backup their accounts in a manner that provides appropriate security and protection from unauthorized access.

DSS users shall ensure that no damage is caused to any products, data or services of any other DSS user or ECMWF.

No use of the DSS JupyterHub Service is allowed for activities which may violate the legal rights of other DSS users or ECMWF, or which may constitute an illegal activity in any form.

If a DSS user becomes aware that their account is compromised or becomes aware of any non-permitted activity, they shall immediately update change their password and contact ECMWF via the support portal.

Uploading of Data, Content and Information

DSS users are responsible for ensuring that data, content and information stored on DSS infrastructure is for purposes aligned with the objectives and legal obligations of ECMWF and the Copernicus services (C3S, CAMS and CEMS).

Additional Service Specifications

Additional Service specifications for the DSS JupyterHub Service can be found on JupyterHub for the ECMWF Data Store Service (DSS).

Ownership, Intellectual Property Rights, Licenses

DSS is operated by ECMWF partly on behalf of the EU. JupyterHub is a third-party software, licensed under Modified BSD License.

Content accessible through the CDS, ADS, EWDS or any other DSS maintained data store may only be used under the terms of the license attributed to it, as updated from time to time by the licensors.

ECMWF does not claim ownership of any software, data, content or information uploaded by the DSS users while using the DSS JupyterHub Service.

DSS users providing software, data and products retain ownership in the items provided. DSS users warrant that they have all the necessary rights to use any of services, applications (including software), data and products used on DSS via the DSS JupyterHub Service.

Control of Access and of Use

ECMWF reserves the right to monitor and screen on-going aggregate activity deemed to be incompliant with these Terms of Use or otherwise unacceptable or inappropriate, be it for legal, security or other reasons.

No Endorsement

No DSS user may publicly represent or imply that ECMWF and/or the EU and/or Jupyter Development Team are participating in, or has sponsored, approved or endorsed the manner or purpose of the use of DSS JupyterHub Service.

Right to Modification

ECMWF reserves the right at any time to modify these Terms of Use and the DSS JupyterHub Service. Any revised Terms of Use will be posted . Modifications shall take effect immediately following posting of the revised Terms of Use.

Discontinuation and Termination

ECMWF reserves the right, at any time, to modify or discontinue, temporarily or permanently, the DSS JupyterHub Service as well as any means of accessing or utilizing it at its sole discretion with or without prior notice to the DSS users.

ECMWF may at its sole discretion, under any circumstances, for any or no reason and with or without prior notice to the DSS users, suspend or terminate any DSS user’s access to the DSS JupyterHub Service, particularly in cases of violation of these Terms of Use or any of the applicable license terms.

Exclusion of Liability and Warranties

Other than in cases of intentional or grossly negligent breaches of duty by its staff or representatives or claims resting on an injury to life, body or health, neither ECMWF nor the EU shall be responsible or liable to any user of the DSS and/or the DSS JupyterHub Service for any loss or damage of any sort incurred in connection with the use of the CDS JupyterHub Service.

ECMWF and/or the EU shall not be responsible or liable for the accuracy, usefulness or availability of the CDS JupyterHub Service.

DSS JupyterHub Service is supplied "as is", on a “best effort” basis and without further warranties of any kind, either express or implied, including, but not limited to, the quality, performance, merchantability or fitness for a particular use or purpose. Subject to the aforesaid, neither ECMWF, nor the EU, nor JupyterHub copyright holders/contributors shall be liable for any damages, including but not limited to direct, indirect, special, incidental, punitive, exemplary or consequential damages (including, but not limited to, procurement of substitute goods or services; loss of use, data, or profits; or business interruption) however caused and on any theory of liability, whether in contract, strict liability, or tort (including negligence or otherwise), arising out of the use of or the inability to use the DSS JupyterHub Service and/or the JupyterHub software, even if advised of the possibility of such damage.

ECMWF and the EU disclaim all warranties related to the provision of DSS JupyterHub Service.

Privileges and Immunities

Nothing in or relating to these Terms of Use shall be deemed a waiver of any of the privileges and immunities of ECMWF and/or the EU in conformity with their respective Protocols on the Privileges and Immunities.

Dispute Settlement

Any dispute between ECMWF and/or the EU and interested parties arising out of or relating to the use of the DSS JupyterHub Service shall be resolved amicably by negotiation. If the dispute cannot be so settled, it shall be finally settled under the Rules of Arbitration of the International Chamber of Commerce by three arbitrators appointed in accordance with the said rules; sitting in London, England. The proceedings shall be in the English language. The right of appeal by either party to any national courts on a question of law arising in the course of any arbitral proceedings or out of an award made in any arbitral proceedings is hereby agreed to be excluded.

Protection of Personal Data

The Copernicus Data Protection and Privacy Statement applies to all personal data provided by the DSS user in order to register.

Severability

If any provision of these Terms of Use is for any reason held to be invalid, illegal or otherwise unenforceable, such unenforceability does not affect any other provision; the Terms of Use are then to be construed as if they had never contained the provision(s) in question and are to be interpreted, in so far as possible, in such a way as to maintain their original intent.

1. Copyright © 2001-2024 Python Software Foundation; All Rights Reserved, License terms available at https://docs.python.org/3/license.html. ↩
2. Copyright (c) 2014-, Jupyter Development Team, All rights reserved. Distributed under the terms of the Modified BSD License. ↩
3. For larger computation tasks, CDS users may consider other JupyterHub resources, for example WEkEO. ↩