Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Warning

Due to the unavailability of NFS-based filesystems at this stage, HOME is temporarily setup on Lustre and PERM is not available yet. 

The filesystems available are HOME, PERM, HPCPERM and SCRATCH, and are completely isolated from those in other ECMWF platforms in Reading such as ECGATE or the Cray HPCF.

...

File System

Suitable for ...

TechnologyFeaturesQuota
HOMEpermanent files, e. g. .profile, utilities, sources, libraries, etc. NFSIt is backed up. Limited I/O performance20GB
PERMpermanent files without the need for automated backups, smaller input files for serial or small processing, std output, etc.NFSIt is backed up. Limited I/O performance20GB1 TB
HPCPERMpermanent files without the need for automated backups,  bigger input files for parallel model runs, climate files, etc.NFS

No Backup

No automatic deletion

1TB10TB
SCRATCHall temporary (large) files. Main storage for your jobs and experiments input and output files.Lustre

Automatic deletion to be configured at a later stage

No backup

4TB50TB

SCRATCHDIR

Big temporary data for an individual session or job, not as fast as TMPDIR but higher capacity. Files accessible from all cluster.Lustre

Deleted at the end of session or job

Created per session/ job as a subdirectory in SCRATCH

part of SCRATCH quota

TMPDIR

Fast temporary data for an individual session or job, small files only. Local to every node.

SSD on shared nodes 

(*f QoSs)

Deleted at the end of session or job

Created per session/ job


3 GB per session/job by default.

Customisable up to 40 GB with 

--gres=ssdtmp:<size>G


RAM on exclusive compute nodes 

(*p QoSs)

no limit (maximum memory of the node)

...