Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

File System

Suitable for ...

TechnologyFeaturesQuota
HOMEpermanent files, e. g. profile, utilities, sources, libraries, etc. NFS

It is backed up.

Snapshots available

Throttled I/O bandwidth (less performance)


Show If
groupecmwf

100GB


Hide If
groupecmwf

10GB


PERMpermanent files without the need for automated backups, smaller input files for serial or small processing, std output, etc.

NFS

No backup

Snapshots will be available (not yet)

Throttled I/O bandwidth (less performance)


Show If
groupecmwf

10 TB


Hide If
groupecmwf

500 GB


HPCPERMpermanent files without the need for automated backups,  bigger input files for parallel model runs, climate files, etc.Lustre

No Backup

No snapshots

No automatic deletion


Show If
groupecmwf

1 TB


Hide If
groupecmwf
  • 100 GB for users without HPC access
  • 1 TB for users with HPC access


SCRATCHall temporary (large) files. Main storage for your jobs and experiments input and output files.Lustre

Automatic deletion after 30 days of last access to be configured at a later stage

No snapshots

No backup


Show If
groupecmwf

50 TB


Hide If
groupecmwf
  • 2 TB for users without HPC access
  • 50 TB for users with HPC access


SCRATCHDIR

Big temporary data for an individual session or job, not as fast as TMPDIR but higher capacity. Files accessible from all cluster.Lustre

Deleted at the end of session or job

Created per session/ job as a subdirectory in SCRATCH

part of SCRATCH quota

TMPDIR

Fast temporary data for an individual session or job, small files only. Local to every node.

SSD on shared (GPIL) nodes 

(*f QoSs)

Deleted at the end of session or job

Created per session/ job


3 GB per session/job by default.

Customisable up to 40 GB with 

--gres=ssdtmp:<size>G


RAM on exclusive parallel compute nodes 

(*p QoSs)

no limit (maximum memory of the node)

...

Tip
titleMore capacity for $TMPDIR?

When running on the shared GPIL nodes (*f QoSs), you may request a bigger space in the SSD-backed TMPDIR with the extra SBATCH option:

No Format
#SBATCH --gres=ssdtmp:<size>G

With <size> being a number up to 40 GB. If that is still not enough for you, you may point your TMPDIR to SCRATCHDIR:

No Format
export TMPDIR=$SCRATCHDIR


...