...
| group | ecmwf |
|---|
The filesystems available are HOME
...
and
...
While HOME and PERM are shared with the Linux VDI service, SCRATCH remains only accessible locally. Filesystems from other ECMWF platforms in Reading such as ECGATE, Linux Clusters, Workstations or the Cray HPCF are not cross-mounted. This means that if you need to use data from another ECMWF platform such as ECGATE or the Cray HPCF, you will need to so transfer it first using scp or rsync. See Linux Virtual Desktop VDI: File transfers for more information.
...
| group | ecmwf |
|---|
...
PERM
...
.
...
File System | Suitable for ... | Technology | Features | Quota |
|---|---|---|---|---|
| HOME | permanent files, e. g. .profile, utilities, sources, libraries, etc. | NFS | It is backed up. Limited I/O performance | 20GBSee HPC2020: Filesystems |
| PERM | permanent files without the need for automated backups, smaller input files for serial or small processing, std output, etc. | NFS | It is backed up. Limited I/O performance | 20GB |
| HPCPERM | permanent files without the need for automated backups, bigger input files for parallel model runs, climate files, etc. | NFS | No Backup No automatic deletion | 1TB |
| SCRATCH | all temporary (large) files. Main storage for your jobs and experiments input and output files. | Lustre | Automatic deletion to be configured at a later stage No backup | 4TB |
SCRATCHDIR | Big temporary data for an individual session or job, not as fast as TMPDIR but higher capacity. Files accessible from all cluster. | Lustre | Deleted at the end of session or job Created per session/ job as a subdirectory in SCRATCH | part of SCRATCH quota | TMPDIR | Fast temporary data for an individual session or job, small files only. Local to every node. | SSD on shared nodes | 3 GB per session/job | RAM on exclusive compute nodes | no limit (maximum memory of the node)
| See HPC2020: Filesystems | ||||
OneDrive | Sharing information with end user device and other ECMWF or external users | Microsoft | Cloud based. See How to configure and mount OneDrive - Linux Virtual Desktop VDI FAQ | 1TB (see OneDrive) |
| Warning |
|---|
Please be aware that any "local" filesystems, like /tmp, will be cleaned up every month when the virtual machine is recreated from the latest updated image. So do not use those to store any information that you may want to keep. |
| Tip | ||
|---|---|---|
| ||
Those filesystems can be conveniently referenced from your session and scripts using the environment variables of the same name: $HOME, $PERM, $HPCPERM, $SCRATCH, $SCRATCHDIR and $TMPDIR.$TEMP, which in the past was an alias to $SCRATCH, has been deprecated and is no longer defined. Please use $SCRATCH instead |
| Tip | ||||
|---|---|---|---|---|
|
| No Format |
|---|
export TMPDIR=$SCRATCHDIR |
| title | How much have I used? |
|---|
You can check your current usage and limits with the "ecquota" command
New filesystem structure
You will notice your filesystems have now a flatter and simpler name structure. If you port any scripts or code that had paths to filesystems hardcoded from older platforms, please make sure you update them. Where possible, try and use the environment variables provided, which should work on both sides pointing to the right location in each case:
...
| Before | After |
|---|---|
| /home/group/user or /home/ms/group/user | /home/user |
| /perm/group/user or /perm/ms/group/user | /perm/user |
| - | /hpcperm/user |
| /scratch/group/user or /scratch/ms/group/user | /scratch/user |
Special directories on RAM
On TEMS, some special directories are not disk-based but actually mapped into the node's main memory. While there are no limits set on exclusive nodes (when running On shared nodes, this could lead to a single application or user consuming a great portion of the total memory available or filling up the existing limits and impacting others. This is why the following limits are set:
...
Users should instead use the general purpose file systems available, and in particular, $TMPDIR or $SCRATCHDIR for temporary storage per session or job. See 188033982.
...
| title | Automatic cleanup |
|---|
...