| Warning |
|---|
Due to the unavailability of NFS-based filesystems at this stage, PERM is temporarily setup on Lustre. |
The filesystems available are HOME, PERM, HPCPERM and SCRATCH, and are completely isolated from those in other ECMWF platforms in Reading such as ECGATE or the Cray HPCF.
...
File System | Suitable for ... | Technology | Features | Quota | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HOME | permanent files, e. g. profile, utilities, sources, libraries, etc. | NFS | It is backed up. Snapshots available Throttled I/O bandwidth (less performance) |
| ||||||||||||||||
| PERM | permanent files without the need for automated backups, smaller input files for serial or small processing, std output, etc. | Temporarily on LustreNFS | It is backed up. Snapshots available Throttled I/O bandwidth (less performance) |
| 16 GB,
| when on NFS
| 16 GB,
| when on NFS|||||||||||||
| HPCPERM | permanent files without the need for automated backups, bigger input files for parallel model runs, climate files, etc. | Lustre | No Backup No snapshots No automatic deletion |
| ||||||||||||||||
| SCRATCH | all temporary (large) files. Main storage for your jobs and experiments input and output files. | Lustre | Automatic deletion after 30 days of last access to be configured at a later stage No snapshots No backup |
| ||||||||||||||||
SCRATCHDIR | Big temporary data for an individual session or job, not as fast as TMPDIR but higher capacity. Files accessible from all cluster. | Lustre | Deleted at the end of session or job Created per session/ job as a subdirectory in SCRATCH | part of SCRATCH quota | ||||||||||||||||
TMPDIR | Fast temporary data for an individual session or job, small files only. Local to every node. | SSD on shared nodes (*f QoSs) | Deleted at the end of session or job Created per session/ job | 3 GB per session/job by default. Customisable up to 40 GB with
| ||||||||||||||||
RAM on exclusive compute nodes (*p QoSs) | no limit (maximum memory of the node) |
...
| Tip | ||
|---|---|---|
| ||
You can check your current usage and limits with the "quota" command. HOME and PERM quotas do not display yet, but will be added soon |
Filesystem structure
You will notice your filesystems have now a flat name structure. If you port any scripts or code that had paths to filesystems hardcoded from older platforms, please make sure you update them. Where possible, try and use the environment variables provided, which should work on both sides pointing to the right location in each case:
...