The are four complexes, virtually identical: AA, AB, AC and AD. All together, this HPCF features 7488 nodes:
- 7020 compute
| Warning |
|---|
TEMS is to be retired at the end of October 2021. See more information here . |
The system is composed of 60 nodes:
- 40 compute nodes, for parallel jobs
- 20 GPIL 448 GPIL (General Purpose and Interactive Login) nodes, which are devised to integrate the interactive and post-processing work that is being currently done on coming from older platforms such as the Cray HPCF, ECGATE and Linux Clusters.
Each node on TEMS comes with:
- 2 x AMD EPYC Rome 7H12
- 512 GiB memory
...
- .
Main differences with the previous Cray XC40 system
The most notorious change is in respect to the previous is on the processor architecture, from Intel to AMD. Although both implement the x86_64 instruction set, the latter has many more cores.
| Cray (CCA/CCB) | Atos | (TEMS)Atos future main systemsHPC2020 (AA/AB/AC/AD) | |
|---|---|---|---|
| CPU Architecture | Intel BroadwellAMD EPYC Rome | AMD EPYC Rome | |
Core Frequency | 2.1 GHz | 2.6 GHz2.5 GHz (GPIL) / 2.25 GHz (compute) | |
| Cores per node (HT) | 36 (72)128 (256) | 128 (256) | |
| Memory per node | 128 GiB | 512 GiB 512 GiB (GPIL) / 256 GiB (compute) | |
| Fabric interconnect | Cray AriesMellanox HDR Infiniband - 100 Gbps | Mellanox HDR Infiniband - 100 Gbps (GPIL) / 200 Gbps (compute) | |
| Operating System | Based on SLES 11 | Based on RHEL 8 | Based on RHEL 8 |
| Batch system | PBS with ALPS | SLURM | SLURM |
| Parallel Filesystem | LustreLustre | Lustre | |
| Compilers | Cray, GNU, Intel GNU, Intel, AOCC | GNU, Intel, AOCC | |
| MPI | Cray MPICHIntel MPI, OpenMPI | Intel MPI, OpenMPI |