The Atos HPCF consists of four virtually identical complexes: AA, AB, AC and AD. In total, this HPCF features 8128 nodes:
- 7680 compute
| Warning |
|---|
TEMS is to be retired at the end of October 2021. See more information here . |
The system is composed of 60 nodes:
- 40 compute nodes, for parallel jobs
- 20 GPIL 448 GPIL (General Purpose and Interactive Login) nodes, which are devised to integrate the interactive and post-processing work that is being currently done on from older platforms such as the Cray HPCF, ECGATE and Linux Clusters.
Each node on TEMS comes with:
- 2 x AMD EPYC Rome 7H12
- 512 GiB memory
...
| Info | ||
|---|---|---|
| ||
There is an additional virtual complex, ECS, which is made from compute nodes of the 4 complexes. This is the one to be used by those users who don't have access to the full HPCF service. |
The logic structure of one of the complexes is as follows:
...
Main differences with the previous Cray XC40 system
The most notorious change is on notable change with respect to the previous Cray XC40 HPCF is in the processor architecture, from Intel to AMD. Although both implement the x86_64 instruction set, the latter has many more cores.
| Cray (CCA/CCB) | Atos ( | TEMSAA/AB/AC/AD) | Atos future main systems | |
|---|---|---|---|---|
| CPU Architecture | Intel BroadwellAMD EPYC Rome | AMD EPYC Rome | ||
Core Frequency | 2.1 GHz2.6 GHz | 2.5 GHz (GPIL) / 2.25 GHz (compute) | ||
| Cores per node (HT) | 36 (72) | 128 (256) | 128 (256) | |
| Memory per node | 128 GiB512 GiB | 512 GiB (GPIL) / 256 GiB (compute) | ||
| Fabric interconnect | Cray Aries | Mellanox HDR | InfinibandInfiniBand - 100 Gbps | Mellanox HDR Infiniband - 100 Gbps (GPIL) / 200 Gbps (compute) |
| Operating System | Based on SLES 11Based on RHEL 8 | Based on RHEL 8 | ||
| Batch system | PBS with ALPSSLURM | SLURM | ||
| Parallel Filesystem | LustreLustre | Lustre | ||
| Compilers | Cray, GNU, Intel | GNU, Intel, AOCC | GNU, Intel, AOCC | |
| MPI | Cray MPICHIntel MPI, OpenMPI | Intel MPI, OpenMPI |