TEMS is to be retired at the end of October 2021. See more information here .
The system is composed of 60 nodes:
- 40 compute nodes, for parallel jobs
- 20 GPIL (General Purpose and Interactive Login) nodes, which are devised to integrate the interactive and post-processing work that is being currently done on the Cray HPCF, ECGATE and Linux Clusters.
Each node on TEMS comes with:
- 2 x AMD EPYC Rome 7H12
- 512 GiB memory
The node configuration of this cluster differs slightly from the future main systems. See below for more details.
Main differences with the previous Cray XC40 system
The most notorious change is on the processor architecture, from Intel to AMD. Although both implement the x86_64 instruction set, the latter has many more cores.
| Cray (CCA/CCB) | Atos (TEMS) | Atos future main systems | |
|---|---|---|---|
| CPU Architecture | Intel Broadwell | AMD EPYC Rome | AMD EPYC Rome |
Core Frequency | 2.1 GHz | 2.6 GHz | 2.5 GHz (GPIL) / 2.25 GHz (compute) |
| Cores per node (HT) | 36 (72) | 128 (256) | 128 (256) |
| Memory per node | 128 GiB | 512 GiB | 512 GiB (GPIL) / 256 GiB (compute) |
| Fabric interconnect | Cray Aries | Mellanox HDR Infiniband - 100 Gbps | Mellanox HDR Infiniband - 100 Gbps (GPIL) / 200 Gbps (compute) |
| Operating System | Based on SLES 11 | Based on RHEL 8 | Based on RHEL 8 |
| Batch system | PBS with ALPS | SLURM | SLURM |
| Parallel Filesystem | Lustre | Lustre | Lustre |
| Compilers | Cray, GNU, Intel | GNU, Intel, AOCC | GNU, Intel, AOCC |
| MPI | Cray MPICH | Intel MPI, OpenMPI | Intel MPI, OpenMPI |