Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Show If
groupecmwf

The filesystems available are HOME, PERM

HOME and PERM are shared with the HPC.  Filesystems from other ECMWF platforms in Reading such as ECGATE, Linux Clusters, Workstations or the Cray HPCF are not cross-mounted. This means that if you need to use data from another ECMWF platform such as ECGATE or the Cray HPCF, you will need to so transfer it first using scp or rsync. See File transfers - Linux Virtual Desktop VDI for more information.


Hide If
groupecmwf

The filesystems available are HOME, PERM, and are completely isolated from those in other ECMWF platforms in Reading such as ECGATE or the Cray HPCF.

Filesystems from those platforms are not cross-mounted either. This means that if you need to use data from another ECMWF platform such as ECGATE or the Cray HPCF, you will need to so transfer it first using scp or rsync. See File transfers - Linux Virtual Desktop VDI for more information.


File System

Suitable for ...

TechnologyFeaturesQuota
HOMEpermanent files, e. g. .profile, utilities, sources, libraries, etc. NFSIt is backed up. Limited I/O performanceSee HPC2020: Filesystems
PERMpermanent files without the need for automated backups, smaller input files for serial or small processing, std output, etc.NFSIt is backed up. Limited I/O performanceSee HPC2020: Filesystems

OneDrive

Sharing information with end user device and other ECMWF or external usersMicrosoft

Cloud based. See How to configure and mount OneDrive - Linux Virtual Desktop VDI FAQ

1TB (see OneDrive)



Warning

Please be aware that any "local" filesystems, like /tmp, will be cleaned up every month when the virtual machine is recreated from the latest updated image. So do not use those to store any information that you may want to keep.


Tip
titleEnvironment variables

Those filesystems can be conveniently referenced from your session and scripts using the environment variables of the same name: $HOME, $PERM .


Tip
titleHow much have I used?

You can check your current usage and limits with the "ecquota" command

New filesystem structure

You will notice your filesystems have now a flatter and simpler name structure. If you port any scripts or code that had paths to filesystems hardcoded from older platforms, please make sure you update them. Where possible, try and use the environment variables provided, which should work on both sides pointing to the right location in each case:


BeforeAfter
/home/group/user or /home/ms/group/user/home/user
/perm/group/user or /perm/ms/group/user/perm/user
-/hpcperm/user
/scratch/group/user or /scratch/ms/group/user/scratch/user