ECMWF is updating updated the default versions of its software packages and libraries used across on Atos HPCF and ECS as part of the regular update cycle.
| Info | ||
|---|---|---|
| ||
The changes will take took place on on Wednesday 15 May 2024 09:00 UTC |
...
Python 3.11 becomes default
For our Python users, we now offer now a more recent version of Python 3.11 with the usual extra modules found on the previous default 3.10. Note that new versions of other packages with python bindings may only come with support for the new Python 3.11.
...
We have recently opened our new ECMWF Jupyterhub service at https://jupyterhub.ecmwf.int. to all users of our HPCF and ECS. While the old software stack is also supported, you will benefit from an updated Jupyter environment and tools. You can find more information about this new way of working on the HPCF and ECS int the in the ECMWF JupyterHub documentation pages.
ECMWF software improvements
There . have been a vast number of improvements and changes on in our ECMWF software and libraries since our last default change in November 2023. See the blog posts for all the software releases since then to learn about what is new in ecCodes, Magics or Metview.
...
All the new versions, both ECMWF and 3rd Party, come with a number of bug fixes and improvements, since it has been 2 years since our last change of default software. You may see the Change change logs and news for any individual package or library in the list below if you want to have all the details.
...
The new versions of the software packages can be selected by using the may24 tag in modules. For example:
|
How to revert to the old versions in case of problems AFTER the update
Users that experience problems with the new default software packages after the update will be able to revert to the old default versions. These can be selected with the commands:
|
| Warning |
|---|
Please let ECMWF know if you need to revert to the old version of any of the packages after the update of the defaults has taken place. |
...
The new version of the ECMWF Toolbox (ecmwf-toolbox module) is 2024.04.0.0, replacing 2023.10.1.0. This table summarises the changes in the version of the different packages within the bundle:
| Package | Default version | Release notes | Download page | |
|---|---|---|---|---|
| Before | After | |||
| CodesUI | 1.7.4 | 1.8.0 | CodesUI - Change History | CodesUI - Releases |
| ecCodes | 2.32.1 | 2.35.0 | ecCodes Releases | |
| Magics | 4.14.1 | 4.15.4 | Latest News | Magics Releases |
| Metview | 5.20.0 | 5.22.0 | Metview Releases | |
| ODC | 1.4.6 | 1.5.0 | Readme | ODC Releases |
Besides ecmwf-toolbox, the following ECMWF packages with their corresponding module also see their default changed:
| ecFlow | 5.11.4 | 5.12. |
|---|
| 4 | ecFlow Releases | |||
| climetlab | 0.12.8 | 0.21.3 | https://github.com/ecmwf/climetlab | https://github.com/ecmwf/climetlab/releases |
|---|
Please see the Release notes for full details of the changes implemented in each package.
...
Some of the versions in this list may already be the default for a specific package, so no changes will be made in those cases.
| Module | Before | After | Release notes |
|---|---|---|---|
| adios | 2.9.2 | 2.9.2 | https://adios2.readthedocs.io/en/latest/ |
| aec | 1.0.6 | 1.1.2 | https://gitlab.dkrz.de/k202009/libaec/-/blob/master/CHANGELOG.md |
| amd-fftw | 3.0.1 | 4.1 | https://github.com/amd/amd-fftw/blob/amd-fftw/ChangeLog |
| ansible | 7.1.0 | 9.2.0 | https://github.com/ansible-community/ansible-build-data/blob/main/7/CHANGELOG-v7.rst |
| antlr | 2.7.7 | 2.7.7 | https://www.antlr2.org/doc/ |
| aocc | 4.0.0 | 4.0.0 | https://www.amd.com/en/developer/aocc.html |
| apptainer |
|---|
| 1.1.8 | 1. |
| 3. |
| 0 | https:// |
| github.com/apptainer/apptainer/blob/main/CHANGELOG.md | |||
| bison | 3.8.2 | 3.8.2 | https://fossies.org/linux/bison/ChangeLog |
|---|---|---|---|
| blis |
| 3.1 | 3.2 | https://github.com/amd/blis/blob/master/CHANGELOG | |
| boost | 1.81.0 | 1.84.0 | https://www.boost.org/users/history/version_1_84_0.html |
| cdo | 2.1.1 | 2. |
Potential issues
ecFlow and python3 incompatibilities
While the ecFlow client and python3 default versions are updated on the HPCF, if you may be running an older version of the ecFlow server. If in your ecFlow tasks you use the ecFlow Python bindings, they may not work with the new default version of Python.
We will update the version of all servers shortly, but in the meantime you may need to either revert to using python3/old in your tasks, or force them to load the new default ecFlow module.