...
Based on user and developer experience of the Climate Data Store (CDS) Toolbox, the CDS-Toolbox has been replaced by a JupyterHub service for the online computing environment and earthkit for the quality assured software. Jupyterhub sessions will be available to all DSS users and provide fast access to data available on the various Data Stores and will allow users to perform post-processing and visualisation of this data. The sessions are considered small (see provision details below) and not designed for very large computation (maximum of 4Gb of memory usage). For larger computation task, users should consider other JupyterHub resources, for example example WEkEO.
| Note | ||
|---|---|---|
| ||
All JupyterHub sessions running on this service are time limited. When the time is up, the instance will be killed automatically along with any active processing that may be taking place. You can only have one session running. If you left one running, JupyterHub will connect you straight back into it. |
...
Once logged in, users are given a choice of environment to use for their Jupyter session session from a dropdown menu, with several additional option depending on which environment you have selected. Please note that by launching a JupyterHub session you are agreeing the terms and conditions of use Terms of Use for the ECMWF Data Store Service JupyterHub.
| Info | ||
|---|---|---|
| ||
This is the general ECMWF JupyterHub launcher, therefore it is possible that you have access to more than the two Data Store options described here |
...
The DSS will offer two forms of storage for use in the JupyterHub. Please be aware that both of these options, and the way that they have been configured, are subject to change as the project develops
| Storage type | Size | Longevity |
|---|---|---|
| Private storage | 1 Gb | Permanent, if used every 31 days. |
| Scratch storage | 100 Gb | Temporary, lifetime depends on overall usage |
Private storage
Each user will have 1Gb "home" storage allocation. If you do not use the JupyterHub service for a period of 31 days the private storage will be removed. This storage is only accessible to you.
...
The scratch disk is a shared resource and is cleaned regularly. When the shared usage of all users exceeds the maximum quote, the files modified least recently will be removed. This means that files stored here should not be considered permanently stored, they should exist for your current session and may be there when you return. The lifetime of these files will depend on the general usage of the service, and at this stage it is not possible to provide an expected lifetime of such files.
Shared resources
There will be is a shared resources directory available from the home in the folder titled notebooks-library. This will be read only and directory contain resources provided by Copernicus and ECMWF. If using these notebooks, for example the notebooks found in the C3S training material.you can save them to your home directory and edit them as you wish. The notebooks library is managed as a git repository which is cloned each time a session is spawned, for reference the repository is here: https://github.com/ecmwf-projects/dss-jupyterhub-notebooks/
External network access
SSH connections are disabled
...