Blog

Throughout the years, new software packages and multiple versions of them have been deployed on our different computing platforms. In preparation for our future migration to Bologna - New Data Centre, we will be streamlining the number of software packages and their versions available, so the majority of the user base is on recent software stacks prior to our move.

To accomplish this, we will extend our annual cleanup cycle, removing in a first stage the modules for unused versions as well as those ones that were never set as default. After the session, you will not be able to load the modules affected.

Some of those modules are still actively used, so you are encouraged to check if any of the packages in the list below is used anywhere in your processing workload. If so, we recommend moving to the current default version for each of those software packages and libraries.

Note that the actual deployments and installations for those software packages are not going to be deleted at this point. This will be done at a later stage. 

If you are using any of the versions affected by this change outside the module system, we strongly recommend moving to the default version for that particular package before the second stage to avoid any future problems

If you have any concerns, please get in touch with our servicedesk@ecmwf.int.

When?

The session is scheduled for Wednesday 18 September 2019 at 10:00 UTC

Where?

The platforms affected are:

  • All clusters in our High Performance Computing Facility, mainly CCA and CCB
  • ECGATE
  • Linux Clusters
  • Linux Desktops

Packages to be retired

These are the packages and versions that will no longer be available through the module system on the different platforms:

PackageVersion
Magics2.20.2
Magics2.24.2
Magics2.26.2
Magics2.29.6
Magics2.30.0
Magics2.32.0
Magics2.32.2
Magics2.33.0
Magics2.35.0
Magics3.0.1
Magics3.0.2
Magics3.0.3
Magics3.2.1
Magics3.3.1
R3.0.1
R3.1.0
R3.1.3
R3.5.1
batch_utils1.0.1
batch_utils1.1
batch_utils1.2
batch_utils1.3
batch_utils1.5
cairo1.15.4
cdftools2.1
cdo1.6.0
cdo1.6.3
cdo1.7.0
cdo1.9.1
cdo1.9.2
cgal4.1
clang3.3
clang3.4
clang5.0.1
cmake2.8.11.2
cmake3.0.2
cmake3.1.2
cmake3.12.0
cmake3.3.2
cmake3.6.2
cmake3.7.1
cmor2.9.3
cmor3.2.2
cmor3.2.3
cmor3.3.3
codes_ui1.0.1
codes_ui1.1.0
codes_ui1.1.0-develop
codes_ui1.2.0-develop
codes_ui1.2.2
codes_ui1.2.3
comfies0.1
comfies0.3
comfies0.4
comfies0.5
comfies0.6
comfies1.0.2
comfies1.0.3
comfies1.0.4
darshan2.3.1-ecm1.2
darshan2.3.1-pre1
darshan2.3.1-single
doxygen1.8.5
ecaccess4.0.2t
ecbuild1.3.1
ecbuild1.3.2
ecbuild1.5.0
ecbuild1.6.0
ecbuild1.9.0
ecbuild2.1.0
ecbuild2.2.0
ecbuild2.3.0
ecbuild2.3.1
ecbuild2.5.0
ecbuild2.5.1
ecbuild2.6.1
ecbuild2.6.2
ecbuild2.7.0
ecbuild2.7.1
ecbuild2.7.2
ecbuild2.7.3
ecbuild2.8.1
ecbuild2.9.0
ecbuild2.9.2
ecbuild2.9.3
ecbuild2.9.4
eccodes0.16.0
eccodes2.0.0
eccodes2.1.0tmp
eccodes2.12.1
eccodes2.6.1
eccodes2.9.1
ecflow4.0.0
ecflow4.0.1
ecflow4.0.2
ecflow4.0.3
ecflow4.0.3.todel
ecflow4.0.4
ecflow4.0.5
ecflow4.0.6
ecflow4.0.7
ecflow4.0.8
ecflow4.0.8rc1
ecflow4.0.9
ecflow4.11.0
ecflow4.11.0-develop
ecflow4.12.0-develop
ecflow4.13.0
ecflow4.14.0
ecflow4.4.0
ecflow4.6.0
ecflow4.6.1
ecflow4.7.0
ecflow4.8.0
ecflowx4.6.0-develop
ecfs2.0.12
ecfs2.0.13rc1
ecfs2.0.13rc2
ecfs2.2.0
ecfs2.2.0-rc1
ecfs2.2.0-rc3
ecfs2.2.1-rc1
ecfs2.2.1-rc2
ecfs2.2.2-rc1
eckit0.12.0
eckit0.13.0
eckit0.23.0
eclib20131118
eclib20131205
ecmp1.1.0
ecpds4.0.0_2013110301
ecpds4.0.2_2014051101
ecpds4.0.2_2014271101
extrae3.4.3
extrae3.6.1
extrae3.6.1-single-mpi-lib
fcm2014.09.0
ferret7.2
ferret7.3-standalone
ferret7.4.2
fftw3.3.7
forge18.0.1
gcc8.2.0
gdal1.9.2
gdal2.0.2
git1.8.4
git2.6.1
grib_api1.12.0
grib_api1.12.1
grib_api1.12.3
grib_api1.12.3.OLD
grib_api1.12.3_dbg
grib_api1.13.0
grib_api1.13.1
grib_api1.19.0
grib_api1.21.0
grib_api1.22.0
grib_api1.23.0
grib_api1.23.1
grib_api1.25.0
grib_api1.26.0
hdf51.10.2
idl8.2
idl8.5.1
ifs-git-tools1.10.0
ifs-git-tools1.11.0
ifs-supportCY41R2.1.WORKS.8.3.1.login
ifs-supportCY41R2.NOTWORK.8.3.1
ifs-supportCY43R1.2
ifs-supportCY43R1.4
ifs-supportCY43R1.5
ifs-supportCY43R1.6
ifs-supportCY43R1.7
ifs-supportCY43R3.1
ifs-supportCY43R3.10
ifs-supportCY43R3.11
ifs-supportCY43R3.2
ifs-supportCY43R3.3
ifs-supportCY43R3.4
ifs-supportCY43R3.5
ifs-supportCY43R3.6
ifs-supportCY43R3.9
ifs-supportCY44R1.0
ifs-supportCY45
ifs-supportCY45R1.0
ifs-supportCY45R1.1
ifs-supportCY45R1.2
ifs-supportCY45R1.4
ifs-supportCY45R1.5
ifs-supportCY45R1.6
ifs-supportCY45R1.8
libemos392
libemos400
libemos407
libemos421
libemos422
libemos430
libemos431
libemos444
libemos445
libemos447
libemos448
libemos449
libemos450
libemos451
libemos453
libemos454
libemos456
libemos457
libemos459
libemos460
met3d1.3.0
met3d2017-11
metpy6.0.1
metpy6.0.3
metpy6.0.4
metview-python0.8.4
metview-python0.8.5dev
metview-python0.8.6
metview-python0.9.1
metview-python1.0.0
metview4.4.5
metview4.6.5
metview4.7.1
metview4.7.2
metview4.8.0
metview4.8.2
metview4.8.4
metview4.8.5
metview4.8.6
metview5.0.0-alpha-8
metview5.0.0-beta-1
metview5.0.1
metview5.0.2
metview5.1.0-develop
metview5.1.1
metview5.2.0
metview5.2.0-develop
metview5.2.1
metview5.2.2
metview5.2.4
metview5.3.0
metview5.3.0-develop
metview5.4.0
metview5.4.0-develop
metview5.5.0
metview5.5.0-develop
metview5.5.1
metview5.6.0-develop2
nag22
nag23
ncl6.1.2
ncl6.2.0
ncl6.3.0
nco4.0.8
nco4.3.1
nco4.6.1
odb1.0.6
odb_api0.10.0
odb_api0.10.5
odb_api0.10.5.4
odb_api0.11.3
odb_api0.12.0
odb_api0.17.2
odb_api0.17.4
odb_api0.17.5
openmpi1.10.3
openmpi1.10.4
openmpi3.0.1
panoply4.5.1
panoply4.7.0
pgen0.10.0.0
pgen0.11.0.1
pgen0.12.0.0
pgen0.12.0.1
pgen0.2.0.0
pgen0.6.0.0
pgen0.7.0.0
pgen0.9.0.0
pgen1.1.0.0
pgen1.1.1.0
pgen1.1.2.0
pgen1.1.3.0
pgen1.1.5.0
pgen1.1.5.1
pgen1.2.0.0
prepifs1.9.1-165
prepifs1.9.1-168
prepifs1.9.1-635
prepifs1.9.1-702
prepifs1.9.1-791
prepifs1.9.1-816
prepifs1.9.1-823
pyg2p2.0.1
python2.7.3-01
python2.7.6-01
python33.5.1-01
python33.6.1-01
quaver1.2.2.1
quaver1.2.4
rttov11.3
slurm14.03.7
subversion1.9.5
swig3.0.12
valgrind3.13.0

Emoslib is one of the packages that will not be migrated to Bologna - New Data Centre. Please start considering using the alternatives suggested.

As part of the retirement of EMOSLIB, access to the current location of the BUFR tables is to be closed. When this happens, any existing program or tool using EMOSLIB for the BUFR decoding/encoding will stop working. This should raise awareness of the places in your workflow that need your attention.

When?

The session is scheduled for Wednesday 11 September 2019 at 10:00 UTC

Where?

The platforms affected are:

  • All clusters in our High Performance Computing Facility, mainly CCA and CCB
  • ECGATE
  • Linux Clusters
  • Linux Desktops

Actions to take

If you are currently using emoslib for the BUFR decoding, you will need to migrate those to ecCodes at some point. However, to continue working with the existing tools or code base as they are, there are two alternatives:

Recommended option

Rebuild your program with the new standalone BUFRDC package. This is the preferred option to make sure your program works well with the package that will be installed in the future platforms. Note that you 

module load bufrdc

The standalone bufrdc library is not installed for older compilers. You may need to switch to more recent compilers in order to use it.

If in a rush or causing operational problems...

You may temporarily keep the existing executables, libraries and tools as they are, but you need load the emos_bufr_tables module before running them. This will make the BUFR tables available for them. 

module load emos_bufr_tables

The  emos_bufr_tables is a compatibility module that will not be ported to future platforms. You should start the migration to ecCodes, or at least make sure you can use the bufrdc standalone package.

ECMWF is updating the default versions of its software packages and libraries used across all user platforms at the centre as part of the regular update cycle.

When?

The changes will take place on  5 June 2019 10:00 - 10:30 UTC

What platforms are affected?

All user platforms at the centre will see their default additional software stack updated:

  • All clusters in our High Performance Computing Facility, mainly CCA and CCB
  • ECGATE
  • Linux Clusters
  • Linux Desktops

Do I need to do anything?

We strongly recommend you test that your programs, scripts and suites work with the new versions of any software or library affected before the change happens.

In particular, if using ecFlow, please make sure you check the triggers in your suites are well defined as described below.

Table of contents

Highlights

Software stack ready for next operational IFS cycle

With the upcoming Implementation of IFS cycle 46R1, this set of defaults is ready to handle the data produced, including all the new parameters introduced in this cycle.

Default GNU compiler updated

The GNU GCC compiler is used by default in our Linux Clusters. After this session, version 7.3 of this popular compiler will be used by default, instead of the old 6.3.

Python 3 Ready

A more complete Python 3 deployment has been made, with all major ECMWF packages supporting it: Magics, Metview, ecFlow and ecCodes (in beta). We encourage all Python users to start migrating their programs to Python 3, as the official support for Python 2 will cease at the end of 2019. Please have a look at the Migration to Python 3 documentation page for more details on how to do this migration.

Metview new features

The new Metview 5.5 features a new set of thermodynamic functions and lots of new functionality for the Geopoints format.  It also uses the new interpolation package MIR by default, replacing the old EMOSLIB interpolation library.

See the Magics and Metview latest news for a more detailed list of changes.

Improved ecFlowUI

This ecFlow release introduces the Timeline View in ecFlowUI. This is available as a tab in the Info Panel and provides a graphical view of node state history taken from the log file, allowing greater overview and analysis of node start and run times. It also supports a Duration view mode, displaying the submission and active times. This mode allows you to filter the nodes of your choice. The Timeline View provides the ideal tool to help you identify and optimise the tasks that are taking too much time.

Update of main third-party software package defaults across all platforms

Once a year we take the opportunity to update not only the software we develop at ECMWF, but also the core 3rd party packages and libraries in our software stack. Amongst the affected packages we can find popular tools and libraries like Python, R,  cdo or netCDF 4. See below for the complete list.

Discontinuation of old PGI compilers

Up to now, we have been providing our software libraries built with a legacy PGI 14 compiler for the FORTRAN parts of the code. This helped with the migration from older platforms to new ones where our default compiler of choice has been the GNU GCC. The new versions becoming default now are no longer available for the PGI environment on those platforms where it is present. If you still use it, please consider moving to the default environment. Note that older versions of our software stack will still be available for a bit longer in case you cannot migrate immediately.

How to use the new versions for testing BEFORE the update

Users are strongly encouraged to test their software applications and data processing chain with the new versions of the various software packages before the date of the change to the default versions.

The new versions of the software packages can be selected by using the jun19 tag in modules. For example:

module swap metview/jun19
module load Magics/jun19
module swap eccodes/jun19 
module swap python/jun19

How to revert to the old versions in case of problems AFTER the update

Users that experience problems with the new default software packages after the update will be able to revert to the old default versions. These can be selected with the commands:

module swap metview/old
module load Magics/old
module swap eccodes/old 
module swap python/old

Please let ECMWF know if you need to revert to the old version of any of the packages after the update of the defaults has taken place. 

Ecflow change: possible impact after upgrading

This release corrects some faulty triggers expression, that may require validation:

ecflow 4.11.0 or less, these are now errors in 4.12.0
...
family f1
   task t1
       trigger f1 == aborted
   task t2
       trigger ./f1 == aborted
corrected triggers in ecflow 4.12.0
...
family f1
   task t1
        trigger ../f1 == aborted
   task t2
        trigger ../f1 == aborted

If your suite contains wrongly defined triggers like the one on the left, they will never be satisfied and therefore the tasks or families depending on them will not run.

It is highly recommended that whenever you migrate to version 4.12 or beyond from an earlier release, you run the checks below. This will highlight problems early, and save you a lot of debug time.

This can be done before we migrate.

  •  If you use python to generate your suite definitions, then simple make sure you run(defs.check())

    module load ecflow/ new
    ...
    # build your python suite definitions
    def = ...
    print defs.check()  #  this will print any problems with triggers and inlimit

  • Alternatively you can use:

    module swap ecflow/ 4.12.0
    ecflow_client --get > tmp.def
    ecflow_client --load tmp.def check_only #  this will print any problems with triggers and inlimit

If you have migrated to the new release, to check all your suites run:

module load ecflow/ 4.12.0
ecflow_client --check=_all_   #  this will print any problems with triggers and inlimits

You have all the details in the ecflow release 4.12.0.

Change list

ECMWF Software

This table summarises the changes in the version of the different packages:

ecCodes is now the official ECMWF encoder and decoder for GRIB and BUFR formats. It supersedes GRIB-API, for the GRIB format, and EMOSLIB, for the BUFR. If you still use any of those, we encourage you to migrate to ecCodes.

PackageDefault versionRelease notesDownload page
BeforeAfter
EMOSLIB4.5.84.6.1History of EMOSLIB changesEMOSLIB Releases

Please see the Release notes for full details of the changes implemented in each package.

GRIB-API is now out of support and not updated any longer. If you are still using it, we strongly encourage you to migrate to ecCodes.


Third-party software

Some of the versions in this list may already be the default for a specific package on a certain platform, so no changes will be made in those cases. After the update, all platforms will have the same defaults for all these packages.


There are many modules of ECMWF and 3rd-party software deployed on all platforms at the centre that, according to our logs, haven't been used for long time. In a first stage in November, we removed the modules for those unused versions.  Now is time to close the access to the actual deployments and installations for those software packages and libraries. Although they are not going to be deleted at this point, they will become unavailable.

Any jobs or programs using any of those items on the list below will most likely fail after the change.

If you are using any of the versions affected, we strongly recommend moving to the default version for that particular package

If you have any concerns, please get in touch with our servicedesk@ecmwf.int.

When?

The session is scheduled for Wednesday 13 February 2019 at 10:00 UTC

What and where?

PlatformModuleVersions affected
ecgateecbuild1.0.10
ecgateecbuild1.5.0
ecgateecbuild1.6.0
ecgateecbuild1.8.0
ecgateecbuild2.7.3
ecgateodb_api0.17.4
ecgatelibemos394
ecgatelibemos400
ecgatelibemos443
ecgatelibemos453
ecgatelibemos454
ecgatelibemos456
ecgategrib_api1.12.0
ecgategrib_api1.12.1
ecgategrib_api1.12.3
ecgategrib_api1.14.0
ecgategrib_api1.23.1
ecgategrib_api1.25.0
ecgategrib_api1.26.0
ecgateMagics2.22.7
ecgateMagics2.23.1
ecgateMagics2.24.2
ecgateMagics2.24.3
ecgateMagics3.0.2
ecgateecfs2.0.13rc2
ecgategmt5.1.1
ecgateodbCY39R1.001
ecgateecflow4.0.1
ecgateecflow4.0.2
ecgateecflow4.0.3
ecgateecflow4.4.0
ecgatefcm2.3.1
ecgatefcm2014.09.0
ecgatefcm2016.10.0
ecgateeckit0.11.0
ecgateeckit0.18.1
ecgateeckit0.6.0
ecgateeckit0.8.0
ecgateschedule1.1
ecgateschedule1.3
ecgateeccodes2.3.0
ecgateeccodes2.9.1
ecgateiris1.10.0
ecgateifs-git-tools1.7.1
ecgateifs-git-tools1.7.2
ecgatecodes_ui1.1.0
ecgatequaver0.5.1
ecgatequaver1.0.0
ecgatequaver1.0.6
ecgateecmp0.1
ecgateecmp0.3
ecgateecmp1.0.1
cca/ccbecbuild2.4.0
cca/ccbecbuild2.7.0
cca/ccbecflow4.7.0
cca/ccbecflow4.8.0
cca/ccbeckit0.15.0
cca/ccbeckit0.18.1
cca/ccbgrib_api1.14.2
cca/ccbgrib_api1.23.0
cca/ccbgrib_api1.26.0
cca/ccblibemos442
cca/ccblibemos443
cca/ccblibemos454
cca/ccblibemos456
cca/ccbodb_api0.10.2
cca/ccbodb_api0.16.1
cca/ccbodb_api0.17.1
cca/ccbodb_api0.17.4
cca/ccbeclib20131118
cca/ccbmetview5.0.0-beta-1
cca/ccbmetview5.1.0
cca/ccbmetview5.1.1
cca/ccbmetview5.2.1
cca/ccbfcm2.2
cca/ccbfcm2.3.1
cca/ccbmetpy5.3.0
cca/ccbmetpy6.emos
cca/ccbeccodes2.9.1
cca/ccbifs-supportCY43R1.0
cca/ccbifs-supportCY43R1.0-UNSTABLE
cca/ccbifs-supportCY43R1.5
cca/ccbifs-supportCY45R1.3
cca/ccbcmor2.9.3
cca/ccbpgenunstable
cca/ccbecmp0.1
cca/ccbecmp0.2
cca/ccbecmp0.3
cca/ccbecmp1.0.1
cctecflow4.0.8
cctecflow4.7.0
cctecflow4.8.0
cctgrib_api1.10.0
cctgrib_api1.12.3
cctgrib_api1.13.0
cctgrib_api1.13.1
cctgrib_api1.14.0
cctgrib_api1.14.2
cctgrib_api1.14.4
cctgrib_api1.25.0
cctgrib_api1.26.0
cctcmake3.3.2
cctboost1.59.0
cctecbuild1.5.0
cctecbuild1.6.0
cctecbuild1.8.0
cctecbuild2.7.3
ccteckit0.11.0
ccteckit0.12.0
ccteckit0.18.1
ccteckit0.6.0
cctecfs2.2.1-rc2
cctlibemos453
cctlibemos454
cctlibemos456
cctlibemos457
ccteccodes2.9.1
cctfcm2.2
cctfcm2.3.1
cckecflow4.7.0
cckecflow4.8.0
cckecbuild2.9.2
cckeckit0.18.1
cckeccodes2.6.0
cckeccodes2.8.1
cckeccodes2.8.2
cckeccodes2.9.1
leap42ecflow4.0.8
leap42ecflow4.6.1
leap42grib_api1.12.1
leap42grib_api1.13.1
leap42grib_api1.14.2
leap42grib_api1.21.0
leap42grib_api1.25.0
leap42libemos443
leap42libemos444
leap42libemos454
leap42metview4.6.0
leap42metview4.6.1
leap42metview4.8.8
leap42cmake3.1.2
leap42javacurrent-5
leap42javacurrent-7
leap42odb_api0.17.2
leap42totalviewtv8.12.0-0
leap42ecbuild1.5.0
leap42ecbuild1.6.0
leap42ecbuild1.8.0
leap42eccodes0.16.0
leap42comfies0.1
leap42cppcheck1.68
leap42cppcheck1.79
leap42valgrind3.11.0
leap42git1.8.4.5
leap42met3d2017-10
leap42ifs-git-tools1.7.1
leap42ifs-git-tools1.7.2
leap42ncchecker0.1.1
leap42ecmp1.0.1
lxcgrib_api1.14.0
lxcgrib_api1.18.0
lxcmetpy5.5.8
lxcecflow4.0.8
lxcecflow4.6.0
lxcecflow4.6.1
lxceckit0.11.0
lxceckit0.18.1
lxcecbuild1.6.0
lxcecbuild1.8.0
lxcecbuild2.7.1
lxcecbuild2.7.2
lxcecbuild2.7.3
lxclibemos453
lxclibemos454
lxclibemos456
lxclibemos457
lxcpgen0.7.0.1
lxcpgen0.8.0.0
lxcpgen0.9.1.0
lxcpgen0.9.2.0
lxcodb_api0.10.2
lxcodb_api0.11.3
lxcodb_api0.17.4
lxcMagics2.32.1
lxcMagics3.0.0
lxcmetview4.6.0
lxcmetview4.6.1
lxcmetview4.8.1
lxcmetview4.8.6
lxcmetview5.0.0-alpha-5
lxcmetview5.0.0-beta-1
lxcmetview5.0.1
lxceccodes2.9.1
lxcifs-supportCY43R3.4
lxcifs-supportCY45R1.0
lxcifs-supportCY45R1.8
lxcwebdev2016-11-09-001
lxcwebdev2016-11-30-001
lxcwebdevfeature-earthserver
lxcwebdevfeature-reduce-latency-in-datastore
lxcwebdevrelease-2015-09-30-0001
lxcwebdevrelease-2015-11-06-001
lxcperl5.12.2-01
lxcifs-git-tools1.7.1
lxcifs-git-tools1.7.2
lxccomfies0.1
lxcecmp0.1
lxcecmp0.3
lxcecmp1.0.1
lxgecbuild2.7.3
lxgecflow4.0.8
lxgecflow4.7.0
lxgecflow4.8.0
lxglibemos451
lxglibemos453
lxglibemos454
lxglibemos456
lxglibemos457
lxgeccodes2.9.1
lxgforge6.0.6
lxgforge7
lxgpython33.5.1-01
lxgifs-git-tools1.7.1
lxgifs-git-tools1.7.2
lxgperl5.12.2-01
lxgfcm2016.10.0
lxgmetview4.7.2
lxgmetview4.8.0
lxgmetview4.8.3
lxgmetview4.8.6
lxgmetview4.8.7
lxgmetview4.8.8
lxgmetview5.0.0-beta-1
lxgmetview5.0.1
lxgmetview5.0.2
lxgmetview5.1.0
lxgmetview5.2.1
lxggrib_api1.21.0
lxopcmake3.3.2
lxopgit1.8.4.5
lxopgit2.8.1
lxopecflow4.7.0
lxopecflow4.8.0
lxoplibemos456
lxoplibemos457
lxopidl8.5.1
lxopMagics2.29.4
lxopMagics3.2.1
lxopeccodes2.9.1
lxopwebdev2016-10-12-002
lxopifs-supportCY45R1.6
lxopcomfies0.1

We are pleased to announce that the new MARS client with MIR, the new interpolation library replacing EMOSLIB, is now considered ready to become the default at ECMWF. This new version has endured months of extensive tests by many users to ensure a smooth transition. This change of the default MARS client is planned for 29 January 2019.

The old MARS/EMOSLIB would still be accessible with:

mars -e

or, if using the WebAPI, with the keyword:

ppengine=emos

You can find some more information about this in our User Documentation wiki space, including the main differences and known issues:

This page will be updated to reflect any updates relevant to this update and the new MARS/MIR client. You may want to "watch" this page to be notified about those updates.

There are many modules of ECMWF and 3rd-party software deployed on all platforms at the centre that, according to our logs, haven't been loaded in 2018. As part of our annual cleanup cycle, in this first stage, we are going to remove the modules for those unused versions. The actual deployments and installations for those software packages are not going to be deleted at this point. This will be done at a later stage after the summer.

If you are using any of the versions affected by this change outside the module system, we strongly recommend moving to the default version for that particular package before the second stage to avoid any future problems

If you have any concerns, please get in touch with our servicedesk@ecmwf.int.

When?

The session is scheduled for Wednesday 28 November 2018 at 11:00 UTC

What and where?

 ecgate
ifs-git-tools
  • 1.7.1
  • 1.7.2
iris
  • 1.10.0
ecflow
  • 4.4.0
eccodes
  • 2.3.0
  • 2.9.1
schedule
  • 1.1
  • 1.3
quaver
  • 0.5.1
  • 1.0.0
  • 1.0.6
fcm
  • 2016.10.0
ecbuild
  • 2.7.3
emos
  • 394
  • 400
  • 443
  • 453
  • 454
  • 456
perforce
  • 2009.2
ecmp
  • 0.1
  • 0.3
  • 1.0.1
ecfs
  • 2.0.13rc2
ecaccess
  • 4.0.1
  • 4.0.2t
grib_api
  • 1.12.0
  • 1.12.1
  • 1.12.3
  • 1.23.1
  • 1.25.0
  • 1.26.0
Magics
  • 2.22.7
  • 2.23.1
  • 3.0.2
codes_ui
  • 1.1.0
odb
  • CY39R1.001
odb_api
  • 0.17.4
eckit
  • 0.18.1
gmt
  • 5.1.1
 cca/ccb
ifs-support
  • CY43R1.0
  • CY43R1.0-UNSTABLE
  • CY43R1.5
  • CY45R1.3
ecflow
  • 4.7.0
  • 4.8.0
eccodes
  • 2.9.1
metview
  • 5.0.0-beta-1
  • 5.1.0
  • 5.1.1
  • 5.2.1
ecbuild
  • 2.4.0
  • 2.7.0
emos
  • 442
  • 443
  • 454
  • 456
metpy
  • 6.emos
ecmp
  • 0.1
  • 0.2
  • 0.3
  • 1.0.1
eclib
  • 20131118
grib_api
  • 1.14.2
  • 1.23.0
  • 1.26.0
odb_api
  • 0.10.2
  • 0.16.1
  • 0.17.1
  • 0.17.4
eckit
  • 0.15.0
  • 0.18.1
  • 0.6.0
cmor
  • 2.9.3
 Leap42 Workstations
ifs-git-tools
  • 1.7.1
  • 1.7.2
ecflow
  • 4.6.1
ncchecker
  • 0.1.1
cmake
  • 3.1.2
eccodes
  • 0.16.0
metview
  • 4.8.8
emos
  • 443
  • 444
  • 454
valgrind
  • 3.11.0
met3d
  • 2017-10
ecmp
  • 1.0.1
comfies
  • 0.1
grib_api
  • 1.21.0
  • 1.25.0
totalview
  • tv8.12.0-0
cppcheck
  • 1.68
  • 1.79
odb_api
  • 0.17.2
 lxc
ifs-git-tools
  • 1.7.1
  • 1.7.2
ifs-support
  • CY43R3.4
  • CY45R1.0
  • CY45R1.8
ecflow
  • 4.6.0
  • 4.6.1
sms
  • 4.4.12
eccodes
  • 2.9.1
pgen
  • 0.7.0.1
  • 0.8.0.0
  • 0.9.1.0
  • 0.9.2.0
quaver
  • 1.1.1
metview
  • 4.8.1
  • 4.8.6
  • 5.0.0-alpha-5
  • 5.0.0-beta-1
  • 5.0.1
ecbuild
  • 2.7.1
  • 2.7.2
  • 2.7.3
emos
  • 453
  • 454
  • 456
  • 457
metpy
  • 5.5.8
ecmp
  • 0.1
  • 0.3
  • 1.0.1
perl
  • 5.12.2-01
ecaccess
  • 4.0.1
  • 4.0.2t
comfies
  • 0.1
Magics
  • 2.24.7
  • 2.32.1
  • 3.0.0
grib_api
  • 1.14.0
  • 1.18.0
webdev
  • 2016-11-09-001
  • 2016-11-30-001
  • feature-earthserver
  • feature-reduce-latency-in-datastore
  • release-2015-09-30-0001
  • release-2015-11-06-001
odb_api
  • 0.10.2
  • 0.17.4
eckit
  • 0.18.1
 lxop
ifs-support
  • CY45R1.6
ecflow
  • 4.7.0
  • 4.8.0
git
  • 1.8.4.5
  • 2.8.1
cmake
  • 3.3.2
eccodes
  • 2.9.1
slurm
  • 15.08.7
emos
  • 456
sms
  • 4.4.12
  • 4.4.15
idl
  • 8.5.1
comfies
  • 0.1
Magics
  • 2.29.4
webdev
  • 2016-10-12-002
 lxg
ifs-git-tools
  • 1.7.1
  • 1.7.2
ecflow
  • 4.7.0
  • 4.8.0
eccodes
  • 2.9.1
metview
  • 4.7.2
  • 4.8.0
  • 4.8.3
  • 4.8.6
  • 4.8.7
  • 4.8.8
  • 5.0.0-beta-1
  • 5.0.1
  • 5.0.2
  • 5.1.0
  • 5.2.1
ecbuild
  • 2.7.3
emos
  • 451
  • 453
  • 454
  • 456
perl
  • 5.12.2-01
grib_api
  • 1.21.0
forge
  • 6.0.6
  • 7.0
python3
  • 3.5.1-01
 cct
ecflow
  • 4.7.0
  • 4.8.0
cmake
  • 3.3.2
eccodes
  • 2.9.1
ecbuild
  • 2.7.3
emos
  • 453
  • 454
  • 456
ecfs
  • 2.2.1-rc2
grib_api
  • 1.25.0
  • 1.26.0
eckit
  • 0.18.1
 cck
ecflow
  • 4.7.0
  • 4.8.0
eccodes
  • 2.6.0
  • 2.8.1
  • 2.8.2
  • 2.9.1
eckit
  • 0.18.1


We are pleased to announce that the new MARS client with MIR, the new interpolation library replacing EMOSLIB, is now considered ready for production and suitable for operational use. It is available on all ECMWF platforms and can be accessed with:

mars -m

Using MARS/MIR through the ECMWF WebAPI can also be done by adding an extra keyword:

ppengine=mir

Although it is still not the default, we would like to encourage you to start using this new MARS/MIR client with your usual workload and report any problems or feedback to servicedesk@ecmwf.int

MARS/MIR will become the default version at ECMWF at the end of January 2019, with the exact date to be confirmed at a later stage. The old MARS/EMOSLIB would still be accessible with:

mars -e

or, if using the WebAPI, with the keyword:

ppengine=emos

You can find some more information about this in our MARS interpolation with MIR page in this User Documentation wiki space, including the main differences and known issues. This page will be updated to reflect any changes or new features, including the exact implementation dates. You may want to "watch" this page to be notified about those updates. 

Do not hesitate to contact servicedesk@ecmwf.int for more information.

ECMWF is updating the default versions of its software packages and libraries used across all user platforms at the centre as part of the regular update cycle.

When?

The changes will take place on Wednesday 21 November 2018 11:00 - 11:30 UTC

What platforms are affected?

All user platforms at the centre will see their default additional software stack updated:

  • All clusters in our High Performance Computing Facility, mainly CCA and CCB
  • ECGATE
  • Linux Clusters
  • Linux Desktops

The next defaults are tagged as "nov18" in modules. After the session the previous defaults will be tagged as "old"

Table of contents

Highlights

A number of bug fixes and performance improvements have been introduced on the different versions to become default. Here are some of the most relevant new features:

  • Magics and Metview now use ecCodes to decode BUFR data.
  • New automatic contouring setting for Magics and Metview to match ECCHARTS styles.
  • BUFR decoding performance has been enhanced in ecCodes, and support for a number or new parameters in GRIB have been added.
  • ecflowUI, the new graphical client for ecFlow, comes with a number of improvements and bug fixes.

How to use the new versions for testing BEFORE the update

Users are strongly encouraged to test their software applications and data processing chain with the new versions of the various software packages before the date of the change to the default versions.

The new versions of the software packages can be selected by using the nov18 tag in modules. For example:

module swap metview/nov18

module load Magics/nov18

module load emos/nov18

module swap eccodes/nov18 

How to revert to the old versions in case of problems AFTER the update

Users that experience problems with the new default software packages after the update of 10 May will be able to revert to the old default versions. These can be selected with the commands:

module swap metview/old

module load Magics/old

module load emos/old

module swap eccodes/old 

Please let ECMWF know if you need to revert to the old version of any of the packages after the update of the defaults has taken place. 

Version changes

This table summarises the changes in the version of the different packages:

ecCodes is now the official ECMWF encoder and decoder for GRIB and BUFR formats. It supersedes GRIB-API, for the GRIB format, and EMOSLIB, for the BUFR. If you still use any of those, we encourage you to migrate to ecCodes.

PackageDefault versionRelease notesDownload page
BeforeAfter
EMOSLIB4.5.54.5.8History of EMOSLIB changesEMOSLIB Releases
GRIB-API1.26.11.27.0

Latest news

GRIB-API Releases

Please see the Release notes for full details of the changes implemented in each package.

Verify: discontinued

Verify (and metpy tagged as metpy/verify) will be discontinued. Please use quaver instead.

There are many modules of ECMWF and 3rd-party software deployed on all platforms at the centre that, according to our logs, haven't been loaded in 2018. In a first stage before the summer, we removed the modules for those unused versions.  Now is time to close the access to the actual deployments and installations for those software packages and libraries. Although they are not going to be deleted at this point, they will become unavailable.

Any jobs or programs using any of those items on the list below will most likely fail after the change.

If you are using any of the versions affected, we strongly recommend moving to the default version for that particular package

If you have any concerns, please get in touch with our servicedesk@ecmwf.int.

When?

The session is scheduled for Wednesday 19 September 2018 at 10:00 UTC

What and where?

PlatformModuleVersions affected
ecgateMagics

2.27.3

2.29.5

2.29.6

2.30.0

2.32.0

2.32.1

2.32.2

2.33.0

2.34.2

ecgateaec0.3
ecgateboost

1.57.0

1.59.0

ecgatecgal4.1
ecgateecbuild

1.9.0

2.4.0

2.5.0

2.5.1

2.6.1

2.7.0

ecgateeccodes

0.16.0

2.0.0

2.0.2

2.4.0

ecgateecflow4.0.9
ecgateecfs2.2.1-rc2
ecgateeckit

0.10.0

0.14.0

0.14.1

0.15.0

0.16.1

0.16.3

ecgateemos

445

447

448

449

450

451

ecgatefcm

2.3.1

2014.09.0

ecgategdal1.10.1
ecgategit1.8.4
ecgategrib_api

1.10.4

1.19.0

1.21.0

1.23.0

ecgatehdf4.2.9
ecgateifs-git-tools

1.6.1

1.7.0

ecgateiris1.9.2
ecgatemetpy5.emos
ecgatemetview

4.4.7

4.5.4

4.5.5

4.5.6

4.5.7

4.5.8

4.6.0

4.6.1

4.6.2

4.6.3

4.6.4

4.6.6

4.7.0

4.7.1

4.7.2

4.8.0

4.8.1

4.8.2

4.8.4

4.8.6

4.8.7

4.8.8

4.9.1-mir-alpha-6

xflexpart-5.0.0-beta

ecgatenetcdf44.2.1.1
ecgateodb

1.0.5

1.0.6

ecgateodb_api

0.10.5.3

0.11.4

0.15.0

0.15.1

0.16.0

0.16.2

0.17.0

0.17.2

0.17.5

cca / ccbaec0.3
cca / ccbecbuild

2.2.0

2.3.0

2.5.0

2.5.1

2.6.1

2.6.2

2.7.1

2.7.2

cca / ccbeccodes0.16.0
cca / ccbecflow

4.4.0

4.6.0

4.6.1

cca / ccbecfs2.0.13rc2
cca / ccbeckit

0.10.0

0.13.1

0.14.0

0.14.1

0.16.3

0.17.0

cca / ccbemos

395

401

440

448

449

450

451

cca / ccbextrae3.4.3-single-mpi-lib
cca / ccbfcm2.2 2.3.1
cca / ccbgit1.8.4
cca / ccbgrib_api

1.9.16

1.12.0

1.14.1

1.19.0

1.22.0

cca / ccbifs-git-tools

1.6.1

1.7.0

cca / ccbifs-support

CY41R2

CY41R2.3

CY43R1.1

CY43R1.6

CY43R1.7

CY43R3.0

CY43R3.1

CY43R3.10

CY43R3.2

CY43R3.3

CY43R3.5

CY43R3.8

CY43R3.9

cca / ccbmetpy

5.3.0

5.5.0

6.1.0

6.1.1

6.1.2

6.2.0

6.2.1

cca / ccbmetview

5.0.0-alpha-8

5.0.1

5.0.2

cca / ccbodb

1.0.5

1.0.6

cca / ccbodb_api

0.10.1

0.10.5.3

0.10.5.4

0.12.0

0.13.0

0.14.0

0.15.0

0.15.1

0.15.2

0.16.0

0.17.0

0.17.2

0.17.5

cca / ccbpython

2.5.6

2.7.5-02

cca / ccbswig3.0.4
cca / ccbudunits2.1.24
cckecbuild

2.6.1

2.7.0

2.7.1

2.7.2

cckeccodes

2.0.0

2.1.0

2.2.0

2.3.0

2.4.0

2.4.1

cckecflow

4.1.0

4.5.0

4.6.0

4.6.1

cckecfs2.2.1-rc2
cckeckit

0.15.0

0.16.1

0.16.3

0.18.0

0.18.5

cckgit2.8.1
cckodb1.0.5
cckpython2.7.5-01
cctboost1.59.0
cctcdo

1.6.4

1.7.0

1.7.2

cctcmake3.1.2
cctdarshan2.3.1-pre1
cctecbuild

2.4.0

2.5.0

2.6.1

2.6.2

2.7.0

2.7.1

2.7.2

ccteccodes

2.0.0

2.0.2

2.1.0

2.2.0

2.3.0

2.4.0

2.4.1

cctecflow

4.1.0

4.4.0

4.5.0

4.6.0

4.6.1

ccteckit

0.12.2

0.14.1

0.15.0

0.16.1

0.16.3

0.17.0

cctemos

443

446

448

449

450

451

cctfcm

2.2

2.3.1

cctgit

1.8.4

2.6.1

2.8.1

cctgrib_api

1.17.0

1.19.0

1.20.0

1.21.0

1.22.0

1.23.0

1.23.1

cctnetcdf44.3.0
cctodb

1.0.2

1.0.5

1.0.6

CY40R1.001

cctodb_api

0.11.4

0.16.1

0.17.0

0.17.1

0.17.2

0.17.4

0.17.5

cctpython

2.5.6

2.7.5-02

2.7.9-01

cctswig3.0.4
cctudunits2.1.24
leap42Magics

2.32.1

2.32.2

2.34.2

leap42aec0.3
leap42cmor2.9.3
leap42cppcheck1.68
leap42ecbuild

2.5.0

2.5.1

2.6.2

2.7.0

leap42ecflow4.4.0
leap42ecfs2.2.1-rc2
leap42eckit

0.11.3

0.16.1

0.17.0

leap42emos

445

447

449

450

leap42git

1.8.4.5

2.6.1

leap42grib_api

1.22.0

1.23.0

1.23.1

1.26.0

leap42idl8
leap42ifs-git-tools

1.6.1

1.7.0

leap42metview4.8.7
leap42ncchecker0.1.1
leap42odbCY40R1.001
leap42odb_api

0.14.0

0.15.0

leap42openjpeg1.5.2
leap42panoply4.6.0
leap42paraver4.6.2
leap42swig1.3.40
leap42udunits2.2.12
lxcMagics

2.32.0

2.33.0

2.34.2

lxcR3.1.3
lxcaec0.3
lxccmake3.0.2
lxcecbuild

2.4.0

2.5.0

2.5.1

2.6.1

2.7.0

lxceccodes

2.0.0

2.2.0

2.3.0

2.4.0

2.4.1

lxcecflow

4.1.0

4.4.0

lxcecfs2.2.1-rc2
lxceckit

CY41R2

0.14.1

0.16.1

0.16.3

lxcemos

441

443

445

446

447

448

449

450

451

lxcforge6.0.6
lxcgit

1.8.4.5

2.6.1

lxcgrib_api

CY41R2

1.13.0

1.16.0

1.19.0

1.20.0

1.21.0

1.22.0

1.23.0

1.23.1

1.25.0

1.26.0

lxcifs-git-tools

1.6.1

1.7.0

lxcifs-support

CY41R2.5

CY43R1.0

CY43R1.0-UNSTABLE

CY43R1.7

CY43R3.10

CY43R3.2

CY43R3.3

CY43R3.5

CY43R3.8

CY44R1.0

CY45R1.3

lxclatex2007
lxcmetpy

5.5.3

5.5.8

lxcmetview

4.7.1

4.8.2

4.8.3

4.8.5

4.8.7

4.8.8

5.0.0-alpha-8

5.0.2

lxcodb

1.0.5

1.0.6

lxcodb_api

0.15.2

0.16.2

0.17.0

0.17.2

0.17.5

lxgaec0.3
lxgcmake3.0.2
lxgecbuild

2.4.0

2.5.0

2.6.1

2.6.2

2.7.0

2.7.1

2.7.2

lxgeccodes

2.0.0

2.0.2

2.1.0

2.2.0

2.3.0

2.4.0

2.4.1

lxgecflow

4.1.0

4.4.0

4.5.0

4.6.0

4.6.1

lxgeckit

0.14.1

0.15.0

0.16.1

0.16.3

0.17.0

0.18.1

lxgemos

444

445

446

447

448

449

450

lxgfcm2016.10.0
lxggdal

1.11.1

2.0.2

lxggit

1.8.4.5

2.6.1

2.8.1

lxggrib_api

1.17.0

1.18.0

1.20.0

1.23.0

1.23.1

1.25.0

1.26.0

lxghdfeos2.19
lxgifs-git-tools

1.6.1

1.7.0

lxgodb

1.0.5

1.0.6

lxgodb_api

0.16.0

0.16.1

0.16.2

0.17.0

0.17.1

0.17.2

0.17.4

0.17.5

lxgpython2.7.8-01
lxopMagics

2.30.0

2.32.0

2.33.0

2.34.2

3.0.2

lxopcdo

1.7.2

1.9.1

lxopeccodes

2.0.0

2.0.2

2.3.0

2.4.0

2.4.1

lxopecflow

4.1.0

4.5.0

4.6.0

4.6.1

lxopecfs2.2.1-rc2
lxopeckit

0.17.0

0.18.1

0.18.5

lxopemos

443

446

449

450

451

453

454

lxopfftw3.3.5
lxopgrib_api

1.20.0

1.23.0

1.23.1

1.25.0

1.26.0

lxopifs-support

CY43R3.7

CY45R1.0

CY45R1.2

CY45R1.3

CY45R1.4

CY45R1.5

CY45R1.7

CY45R1.8

lxopmetview

4.7.1

4.8.3

4.8.4

4.8.7

4.8.8

5.0.0-alpha-8

5.0.1

5.0.2

lxopnco4.6.1
lxopodb1.0.6
lxopodb_api

0.16.0

0.17.0

0.17.1

0.17.2

0.17.4

0.17.5

There are many modules of ECMWF and 3rd-party software deployed on all platforms at the centre that, according to our logs, haven't been loaded in 2018. As part of our annual cleanup cycle, in this first stage, we are going to remove the modules for those unused versions. The actual deployments and installations for those software packages are not going to be deleted at this point. This will be done at a later stage after the summer.

If you are using any of the versions affected by this change outside the module system, we strongly recommend moving to the default version for that particular package before the second stage to avoid any future problems

If you have any concerns, please get in touch with our servicedesk@ecmwf.int.

When?

The session is scheduled for Wednesday 4 July 2018 at 10:00 UTC

What and where?

PlatformModuleVersions affected
ecgateMagics

2.27.3

2.29.5

2.29.6

2.30.0

2.32.0

2.32.1

2.32.2

2.33.0

2.34.2

ecgateaec0.3
ecgateboost

1.57.0

1.59.0

ecgatecgal4.1
ecgateecbuild

1.9.0

2.4.0

2.5.0

2.5.1

2.6.1

2.7.0

ecgateeccodes

0.16.0

2.0.0

2.0.2

2.4.0

ecgateecflow4.0.9
ecgateecfs2.2.1-rc2
ecgateeckit

0.10.0

0.12.2

0.14.0

0.14.1

0.15.0

0.16.1

0.16.3

ecgateemos

445

447

448

449

450

451

ecgatefcm

2.3.1

2014.09.0

ecgategdal1.10.1
ecgategit1.8.4
ecgategrib_api

1.10.4

1.19.0

1.21.0

1.23.0

ecgatehdf4.2.9
ecgateifs-git-tools

1.6.1

1.7.0

ecgateiris1.9.2
ecgatemetpy5.emos
ecgatemetview

4.4.7

4.5.4

4.5.5

4.5.6

4.5.7

4.5.8

4.6.0

4.6.1

4.6.2

4.6.3

4.6.4

4.6.6

4.7.0

4.7.1

4.7.2

4.8.0

4.8.1

4.8.2

4.8.4

4.8.6

4.8.7

4.8.8

4.9.1-mir-alpha-6

xflexpart-5.0.0-beta

ecgatenetcdf44.2.1.1
ecgateodb

1.0.5

1.0.6

ecgateodb_api

0.10.5.3

0.11.4

0.15.0

0.15.1

0.16.0

0.16.2

0.17.0

0.17.2

0.17.5

cca / ccbaec0.3
cca / ccbecbuild

2.2.0

2.3.0

2.5.0

2.5.1

2.6.1

2.6.2

2.7.1

2.7.2

cca / ccbeccodes0.16.0
cca / ccbecflow

4.4.0

4.6.0

4.6.1

cca / ccbecfs2.0.13rc2
cca / ccbeckit

0.10.0

0.13.1

0.14.0

0.14.1

0.16.3

0.17.0

cca / ccbemos

395

401

440

448

449

450

451

cca / ccbextrae3.4.3-single-mpi-lib
cca / ccbfcm2.2 2.3.1
cca / ccbfdb

4.4.0

4.6.5

4.7.0

CY41R2.1

cca / ccbgit1.8.4
cca / ccbgrib_api

1.9.16

1.12.0

1.14.1

1.19.0

1.22.0

cca / ccbifs-git-tools

1.6.1

1.7.0

cca / ccbifs-support

CY41R2

CY41R2.3

CY43R1.1

CY43R1.6

CY43R1.7

CY43R3.0

CY43R3.1

CY43R3.10

CY43R3.2

CY43R3.3

CY43R3.5

CY43R3.8

CY43R3.9

cca / ccbmetpy

5.3.0

5.5.0

6.1.0

6.1.1

6.1.2

6.2.0

6.2.1

cca / ccbmetview

5.0.0-alpha-8

5.0.1

5.0.2

cca / ccbodb

1.0.5

1.0.6

cca / ccbodb_api

0.10.1

0.10.5.3

0.10.5.4

0.12.0

0.13.0

0.14.0

0.15.0

0.15.1

0.15.2

0.16.0

0.17.0

0.17.2

0.17.5

cca / ccbpython

2.5.6

2.7.5-02

cca / ccbswig3.0.4
cca / ccbudunits2.1.24
cckecbuild

2.6.1

2.7.0

2.7.1

2.7.2

cckeccodes

2.0.0

2.1.0

2.2.0

2.3.0

2.4.0

2.4.1

cckecflow

4.1.0

4.5.0

4.6.0

4.6.1

cckecfs2.2.1-rc2
cckeckit

0.15.0

0.16.1

0.16.3

0.18.0

0.18.5

cckgit2.8.1
cckodb1.0.5
cckpython2.7.5-01
cctboost1.59.0
cctcdo

1.6.4

1.7.0

1.7.2

cctcmake3.1.2
cctdarshan2.3.1-pre1
cctecbuild

2.4.0

2.5.0

2.6.1

2.6.2

2.7.0

2.7.1

2.7.2

ccteccodes

2.0.0

2.0.2

2.1.0

2.2.0

2.3.0

2.4.0

2.4.1

cctecflow

4.1.0

4.4.0

4.5.0

4.6.0

4.6.1

ccteckit

0.12.2

0.14.1

0.15.0

0.16.1

0.16.3

0.17.0

cctemos

443

446

448

449

450

451

cctfcm

2.2

2.3.1

cctgit

1.8.4

2.6.1

2.8.1

cctgrib_api

1.17.0

1.19.0

1.20.0

1.21.0

1.22.0

1.23.0

1.23.1

cctnetcdf44.3.0
cctodb

1.0.2

1.0.5

1.0.6

CY40R1.001

cctodb_api

0.11.4

0.16.1

0.17.0

0.17.1

0.17.2

0.17.4

0.17.5

cctpython

2.5.6

2.7.5-02

2.7.9-01

cctswig3.0.4
cctudunits2.1.24
leap42Magics

2.32.1

2.32.2

2.34.2

leap42aec0.3
leap42cmor2.9.3
leap42cppcheck1.68
leap42ecbuild

2.5.0

2.5.1

2.6.2

2.7.0

leap42ecflow4.4.0
leap42ecfs2.2.1-rc2
leap42eckit

0.11.3

0.16.1

0.17.0

leap42emos

445

447

449

450

leap42git

1.8.4.5

2.6.1

leap42grib_api

1.22.0

1.23.0

1.23.1

1.26.0

leap42idl8
leap42ifs-git-tools

1.6.1

1.7.0

leap42metview4.8.7
leap42ncchecker0.1.1
leap42odbCY40R1.001
leap42odb_api

0.14.0

0.15.0

leap42openjpeg1.5.2
leap42panoply4.6.0
leap42paraver4.6.2
leap42swig1.3.40
leap42udunits2.2.12
lxcMagics

2.24.7

2.32.0

2.33.0

2.34.2

lxcR3.1.3
lxcaec0.3
lxccmake3.0.2
lxcecbuild

2.4.0

2.5.0

2.5.1

2.6.1

2.7.0

lxceccodes

2.0.0

2.2.0

2.3.0

2.4.0

2.4.1

lxcecflow

4.1.0

4.4.0

lxcecfs2.2.1-rc2
lxceckit

CY41R2

0.8.0

0.14.1

0.16.1

0.16.3

lxcemos

441

443

445

446

447

448

449

450

451

lxcforge6.0.6
lxcgit

1.8.4.5

2.6.1

lxcgrib_api

CY41R2

1.13.0

1.16.0

1.19.0

1.20.0

1.21.0

1.22.0

1.23.0

1.23.1

1.25.0

1.26.0

lxcifs-git-tools

1.6.1

1.7.0

lxcifs-support

CY41R2.5

CY43R1.0

CY43R1.0-UNSTABLE

CY43R1.7

CY43R3.10

CY43R3.2

CY43R3.3

CY43R3.5

CY43R3.8

CY44R1.0

CY45R1.3

lxclatex2007
lxcmetpy

5.5.3

5.5.8

lxcmetview

4.7.1

4.8.2

4.8.3

4.8.5

4.8.7

4.8.8

5.0.0-alpha-8

5.0.2

lxcodb

1.0.5

1.0.6

lxcodb_api

0.15.2

0.16.2

0.17.0

0.17.2

0.17.5

lxgaec0.3
lxgcmake3.0.2
lxgecbuild

2.4.0

2.5.0

2.6.1

2.6.2

2.7.0

2.7.1

2.7.2

lxgeccodes

2.0.0

2.0.2

2.1.0

2.2.0

2.3.0

2.4.0

2.4.1

lxgecflow

4.1.0

4.4.0

4.5.0

4.6.0

4.6.1

lxgeckit

0.14.1

0.15.0

0.16.1

0.16.3

0.17.0

0.18.1

lxgemos

444

445

446

447

448

449

450

lxgfcm2016.10.0
lxggdal

1.11.1

2.0.2

lxggit

1.8.4.5

2.6.1

2.8.1

lxggrib_api

1.17.0

1.18.0

1.20.0

1.23.0

1.23.1

1.25.0

1.26.0

lxghdfeos2.19
lxgifs-git-tools

1.6.1

1.7.0

lxgodb

1.0.5

1.0.6

lxgodb_api

0.16.0

0.16.1

0.16.2

0.17.0

0.17.1

0.17.2

0.17.4

0.17.5

lxgpython2.7.8-01
lxopMagics

2.30.0

2.32.0

2.33.0

2.34.2

3.0.2

lxopcdo

1.7.2

1.9.1

lxopeccodes

2.0.0

2.0.2

2.3.0

2.4.0

2.4.1

lxopecflow

4.1.0

4.5.0

4.6.0

4.6.1

lxopecfs2.2.1-rc2
lxopeckit

0.17.0

0.18.1

0.18.5

lxopemos

443

446

449

450

451

453

454

lxopfftw3.3.5
lxopgrib_api

1.20.0

1.23.0

1.23.1

1.25.0

1.26.0

lxopifs-support

CY43R3.7

CY45R1.0

CY45R1.2

CY45R1.3

CY45R1.4

CY45R1.5

CY45R1.7

CY45R1.8

lxopmetview

4.7.1

4.8.3

4.8.4

4.8.7

4.8.8

5.0.0-alpha-8

5.0.1

5.0.2

lxopnco4.6.1
lxopodb1.0.6
lxopodb_api

0.16.0

0.17.0

0.17.1

0.17.2

0.17.4

0.17.5


ECMWF is updating the default versions of its software packages and libraries used across all user platforms at the centre as part of the regular update cycle.

When?

The changes will take place on  22 May 2018 10:00 - 10:30 UTC

What platforms are affected?

All user platforms at the centre will see their default additional software stack updated:

  • All clusters in our High Performance Computing Facility, mainly CCA and CCB
  • ECGATE
  • Linux Clusters
  • Linux Desktops

Table of contents

Highlights

Software stack ready for next operational IFS cycle

With the upcoming Implementation of IFS cycle 45r1, this set of defaults is ready to handle the data produced, including all the new parameters introduced  in this cycle

Magics 3 and Metview 5

Both Magics and Metview see their major version updated.

Magics comes with some improvements on the visualisation of NetCDF-CF and colour setting gradients, and support for Python 3.

Metview 5 will benefit from the new features of Magics 3,  plus interesting features such as a new interactive layer management, per-colour transparency and FLEXPART support, among others. 

See the Magics and Metview latest news for a more detailed list of changes.

CodesUI first stable release

CodesUI is an interactive graphical application built on ecCodes to inspect GRIB and BUFR messages, that has now reached the first public release.

Consolidation of main third-party software package defaults across all platforms

The default versions for other third party software and libraries have historically diverged in the different platforms at the centre. We will take this opportunity to converge our defaults to the same versions across all those platforms, so we can offer a more consistent environment and user experience. Amongst the affected packages we can find popular tools and libraries like Python, R,  cdo or netCDF 4. See below for the complete list.

How to use the new versions for testing BEFORE the update

Users are strongly encouraged to test their software applications and data processing chain with the new versions of the various software packages before the date of the change to the default versions.

The new versions of the software packages can be selected by using the may18 tag in modules. For example:

module swap metview/may18
module load Magics/may18
module swap eccodes/may18 
module swap python/may18

How to revert to the old versions in case of problems AFTER the updateUsers that experience problems with the new default software packages after the update of 10 May will be able to revert to the old default versions. These can be selected with the commands:

module swap metview/old
module load Magics/old
module swap eccodes/old 
module swap python/old

Please let ECMWF know if you need to revert to the old version of any of the packages after the update of the defaults has taken place. 

Change list

ECMWF Software

This table summarises the changes in the version of the different packages:

ecCodes is now the official ECMWF encoder and decoder for GRIB and BUFR formats. It supersedes GRIB-API, for the GRIB format, and EMOSLIB, for the BUFR. If you still use any of those, we encourage you to migrate to ecCodes.

PackageDefault versionRelease notesDownload page
BeforeAfter
EMOSLIB4.5.24.5.5History of EMOSLIB changesEMOSLIB Releases
GRIB-API1.24.01.26.1

Latest news

GRIB-API Releases

Please see the Release notes for full details of the changes implemented in each package.

Third-party software

Some of the versions in this list may already be the default for a specific package on a certain platform, so no changes will be made in those cases. After the update, all platforms will have the same defaults for all these packages.

PackageNext defaultNotes
boost1.61.0http://www.boost.org/users/history/version_1_61_0.html
cdo1.8.2

With Grib, netcdf 4, hdf5 and Magics support

https://code.zmaw.de/news/349

cmake3.10.2https://cmake.org/cmake/help/v3.10/release/3.10.html
forge18.1.3https://developer.arm.com/products/software-development-tools/hpc/downloads/download-arm-forge
gdal2.1.1https://trac.osgeo.org/gdal/wiki/Release/2.1.1-News
geos3.5.0https://trac.osgeo.org/geos/browser/tags/3.6.0/NEWS
git2.16.2https://github.com/git/git/tree/master/Documentation/RelNotes
gsl2.2.1http://git.savannah.gnu.org/cgit/gsl.git/tree/NEWS
hdf4.2.12https://support.hdfgroup.org/ftp/HDF/releases/HDF4.2.12/src/hdf-4.2.12-RELEASE.txt
hdf51.8.17https://support.hdfgroup.org/ftp/HDF5/releases/ReleaseFiles/hdf5-1.8.17-RELEASE.txt
intel17.0.3https://software.intel.com/en-us/articles/intel-parallel-studio-xe-2017-update-3-readme
nag24

A number of  a number of routines in the "G05 – 
Random Number Generators" chapter have been withdrawn.

https://www.nag.co.uk/numeric/fl/nagdoc_fl24/html/GENINT/replace.html

ncl6.4.0http://www.ncl.ucar.edu/prev_releases.shtml
nco4.6.7http://nco.sourceforge.net/ANNOUNCE
netcdf44.4.1http://www.unidata.ucar.edu/blogs/news/entry/netcdf-4-4-1
proj44.9.2https://github.com/OSGeo/proj.4/blob/4.9.2/ChangeLog
python2.7.12-01

More up-to-date extra python modules

MKL used for linear algebra in numpy and scipy

https://hg.python.org/cpython/raw-file/v2.7.12/Misc/NEWS

python33.6.5-01https://docs.python.org/3/whatsnew/3.6.html
R3.3.1

More up-to-date extra R packages

MKL used for all linear algebra operations

https://cran.r-project.org/doc/manuals/r-release/NEWS.html

udunits2.2.17https://abi-laboratory.pro/tracker/changelog/udunits/2.2.17/log.html



We would like to inform you that GCC 6.3 will become the default GNU compiler on Linux platforms, with the exception of the supercomputers.

GCC 6.3 has been the default GNU compiler on the supercomputers since November 2017.

When is this happening?

This change will take place on 11 April 2018 at 11 UTC.

How can I test the new compilers?

In order to test this new compiler set before the actual change, simply run the following line before you build your programs:

module swap gnu/new

After the upgrade, if you detect any issues, you may go back to the previous default compiler by running:

module swap gnu/old

Do I need to recompile my programs?

There is no immediate need to recompile all your programs at this point. Your existing executables and libraries will continue to work as they are. You may temporarily continue using the older compiler since it will remain installed. Nevertheless, we strongly recommend you to test the new compilers before this upgrade, to make sure you are ready to use them.

 Future versions of ECMWF and 3rd party software and libraries will only be made available for the latest compilers.

More updates coming up...

Please note that as part of our regular software update cycle, other ECMWF and 3rd party software and libraries will also see their default versions updated in May 2018 across all ECMWF platforms. Further details on the packages and versions selected, as well as the exact date of implementation, will be announced at a later stage.

Still using csh? 

If you are still using csh as your login shell, you should consider moving to bash or ksh. These are the fully supported shells across all ECMWF platforms, with bash being the default for new users and the recommended one. Csh has not been supported on our supercomputers for several years, and may become completely unsupported in the future across all the other computing platforms at ECMWF. To change it, just run the command *changesh* on ecgate and follow the instructions.

This change is combined with the update on the default compiler stacks on our Cray HPCF. See 2017 Compiling environment upgrade on HPCs for more information

ECMWF is changing the default versions of its software packages and libraries used across all user platforms at the centre on the following dates:

PlatformsDate
CCBWednesday 22 November 2017 11:00 - 11:30 UTC

CCA

ECGATE

DESKTOPS

LINUX CLUSTERS

Wednesday 29 November 2017 11:00 - 11:30 UTC

Version changes

This table summarises the changes in the version of the different packages:

Please see the Release notes for full details of the changes implemented in each package.

The next defaults are tagged as "nov17" in modules. After the session the previous defaults will be tagged as "old"

How to use the new versions for testing BEFORE the update

Users are strongly encouraged to test their software applications and data processing chain with the new versions of the various software packages before the date of the change to the default versions.

The new versions of the software packages can be selected by using the nov17 tag in modules. For example:

module swap metview/nov17

module load Magics/nov17

module swap emos/nov17

module swap eccodes/nov17 

How to revert to the old versions in case of problems AFTER the update

Users that experience problems with the new default software packages after the update of 10 May will be able to revert to the old default versions. These can be selected with the commands:

module swap metview/old

module load Magics/old

module swap emos/old

module swap eccodes/old 

Please let ECMWF know if you need to revert to the old version of any of the packages after the update of the defaults has taken place. 

Reverting to older versions of ecflow (for server only)

Ecflow 4.7.0 introduces a new file format for the checkpoint files, which is where ecflow keeps the state of the suites so it can recover from a failure or a server stop. This new version of ecflow can work with both formats, being able to load a checkpoint from an older version. However, it will always write out the checkpoints using the new format, so older versions of ecflow will not be able to read it.

if you need to revert your server to an older version once the new server has been used, you need to do the following:

  1. Stop the running new (>=4.7.0) server.
  2. With your ecflow server stopped, locate the checkpoint files, in ECF_HOME  and move them aside with a different name.
  3. Start the old (<4.7.0) server, which will appear completely empty.
  4. Since the new format of the checkpoint uses de ecflow definition language, you can load it as if it was a normal suite, with ecflow_client --load checkpoint_name.

ecCodes superseding GRIB API

ecCodes replaces GRIB API as the default GRIB decoder at ECMWF. The grib_api module will no longer be loaded by default. ecCodes will be loaded instead. This change could affect your scripts or user setup. See below for details.

ECMWF will change the default versions of its software packages and libraries used across all user platforms at the centre (ecgate, desktops, lxc, cca and ccb) between 10:00 and 10:30 UTC on Wednesday 10 May 2017.

Version changes

This table summarises the changes in the version of the different packages:

Please see the Release notes for full details of the changes implemented in each package.

The next defaults are tagged as "may17" in modules. After the session the previous defaults will be tagged as "old"

IMPORTANT: ecCodes replaces GRIB API as the default GRIB decoder

As part of this change in the default ECMWF software stack, ecCodes will become the default GRIB decoder at the centre superseding GRIB API. ecCodes provides a set of equivalent command line tools and compatible libraries. All the variables defined by the grib_api module for the compilation of programs and the python bindings are also provided for backwards compatibility. See the GRIB-API migration page for details on the differences between GRIB API and ecCodes.


The grib_api module, which used to be part of the default shell environment, will no longer be automatically loaded after the change. Instead, the eccodes module will be automatically loaded.

Anyone loading or switching to a particular version of the grib_api module in their scripts or user setup must make sure that it can work after the change and make the necessary amendments otherwise.

Example

The following commands will fail after the change on a default environment, because it is assumed that the grib_api module is loaded, and that eccodes is not:

module swap grib_api/old
# or
module unload grib_api
module load grib_api/old

First of all, the recommendation is to use ecCodes instead, so no swap would be required. However, if you have a good reason to continue using a particular version of GRIB API, then the more robust way to make sure it works in all cases would be:

module unload grib_api eccodes
module load grib_api/old

Please let ECMWF know if you need to revert to grib_api after the update of 10 May 2017.

How to use the new versions for testing BEFORE the update

Users are strongly encouraged to test their software applications and data processing chain with the new versions of the various software packages before the date of the change to the default versions.

The new versions of the software packages can be selected by using the may17 tag in modules. For example:

module swap metview/may17

module load Magics/may17

module swap emos/may17

module swap grib_api eccodes/may17 

How to revert to the old versions in case of problems AFTER the update

Users that experience problems with the new default software packages after the update of 10 May will be able to revert to the old default versions. These can be selected with the commands:

module swap metview/old

module load Magics/old

module swap emos/old

module swap eccodes grib_api/old 

Please let ECMWF know if you need to revert to the old version of any of the packages after the update of 10 May 2017.