Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Warning

TEMS is to be retired at the end of October 2021. See more information here .

No filesystems from other platforms are cross-mounted, so you will need to copy over what you need.

...

For transfers, we recommend using rsync which will transfer the files over an ssh connection.

Example: Transferring a directory tree between ECGATE onto

...

the Atos HPCF

You may initiate the transfer from ECGATE:

No Format
user@ecgb11:~> rsync -av $SCRATCH/mydataset temsaa:/scratch/user/

or alternatively from TEMSAtos HPCF:

No Format
user@atuser@aa-login1106:~> rsync -av ecgate:/scratch/group/user/mydataset $SCRATCH/

...

Warning

You can use the $HOME environment variable to refer to your files in the rsync command provided this is protected by single quotes to ensure the variable is expanded on the remote host.

For example,  to copy a directory from $HOME on ecgate to $HOME on TEMSAtos HPCF, initiating the transfer from ecgate, use:

No Format
rsync -av $HOME/mydataset 'temsaa:$HOME/'


However, the $SCRATCH or $PERM environment variables can only be used to refer to your files on the local host from where you initiate the rsync command (either TEMS or ecgate) as these are not set for use by the rsync command on the remote host.

An alternative option is to use the $HOME variable with pattern substitution.  For example, to copy a directory tree from $SCRATCH on ecgate to $SCRATCH on TEMS Atos HPCF running the command on ecgate use:

No Format
user@ecgb11:~> rsync -av $SCRATCH/mydataset 'temsaa:${HOME/home/scratch}/'

or from $PERM on ecgate to $PERM on TEMS Atos HPCF running the command on TEMS the latter use:

No Format
user@atuser@aa-login1100:~> rsync -av 'ecgate:${HOME/home/perm}/mydataset' $PERM/

The single quotes are needed here to ensure the $HOME variable takes its value on the remote rather than the local host.

...