| Warning |
|---|
TEMS is to be retired at the end of October 2021. See more information here . |
| Show If | ||
|---|---|---|
| ||
The filesystems available are HOME, PERM, HPCPERM and SCRATCH. While HOME and PERM are shared with the Linux VDI service, SCRATCH remains only accessible locally. Filesystems from other ECMWF platforms in Reading such as ECGATE, Linux Clusters, Workstations or the Cray HPCF are not cross-mounted. This means that if you need to use data from another ECMWF platform such as ECGATE or the Cray HPCF, you will need to so transfer it first using scp or rsync. See HPC2020: File transfers for more information. |
| Hide If | ||
|---|---|---|
| ||
The filesystems available are HOME, PERM, HPCPERM and SCRATCH, and are completely isolated from those in other ECMWF platforms in Reading such as ECGATE or the Cray HPCF. Filesystems from those platforms are not cross-mounted either. This means that if you need to use data from another ECMWF platform such as ECGATE or the Cray HPCF, you will need to so transfer it first using scp or rsync. See HPC2020: File transfers for more information. |
...
| Tip | ||
|---|---|---|
| ||
You can check your current usage and limits with the "quota" command |
New filesystem structure
You will notice your filesystems have now a flatter and simpler name structure. If you port any scripts or code that had paths to filesystems hardcoded from older platforms, please make sure you update them. Where possible, try and use the environment variables provided, which should work on both sides pointing to the right location in each case:
...
| Before | After |
|---|---|
| /home/group/user or /home/ms/group/user | /home/user |
| /perm/group/user or /perm/ms/group/user | /perm/user |
| - | /hpcperm/user |
| /scratch/group/user or /scratch/ms/group/user | /scratch/user |
Special directories on RAM
On TEMS, some special directories are not disk-based but actually mapped into the node's main memory. While there are no limits set on exclusive nodes (when running On shared nodes, this could lead to a single application or user consuming a great portion of the total memory available or filling up the existing limits and impacting others. This is why the following limits are set:
...
Users should instead use the general purpose file systems available, and in particular, $TMPDIR or $SCRATCHDIR for temporary storage per session or job. See HPC2020: FilesysHPC2020Filesystems.
| Note | ||
|---|---|---|
| ||
Any data left on those spaces will be automatically deleted at the end of the job or session. |
...