No filesystems from other platforms are cross-mounted, so you will need to copy over what you need.
First of all, make sure you have set up password-less authentication as described in HPC2020: How to connect before proceeding.
For transfers, we recommend using rsync which will transfer the files over an ssh connection.
All examples are done with the AA complex, but you should use ecs-login if you don't have access to the full HPCF service.
Example: Transferring a directory tree between ECGATE onto the Atos HPCF
You may initiate the transfer from ECGATE:
user@ecgb11:~> rsync -av $SCRATCH/mydataset aa-login:/scratch/user/
or alternatively from Atos HPCF:
user@aa6-100:~> rsync -av ecgate:/scratch/group/user/mydataset $SCRATCH/
Both solutions are equivalent, and can be run multiple times. Only new files will be transferred.
You may add the --delete option if you also wish to delete files on the destination that have been removed from the source.
You can use the $HOME environment variable to refer to your files in the rsync command provided this is protected by single quotes to ensure the variable is expanded on the remote host.
For example, to copy a directory from $HOME on ecgate to $HOME on Atos HPCF, initiating the transfer from ecgate, use:
rsync -av $HOME/mydataset 'aa-login:$HOME/'
However, the $SCRATCH or $PERM environment variables can only be used to refer to your files on the local host from where you initiate the rsync command as these are not set for use by the rsync command on the remote host.
An alternative option is to use the $HOME variable with pattern substitution. For example, to copy a directory tree from $SCRATCH on ecgate to $SCRATCH on Atos HPCF running the command on ecgate use:
user@ecgb11:~> rsync -av $SCRATCH/mydataset 'aa-login:${HOME/home/scratch}/'
or from $PERM on ecgate to $PERM on Atos HPCF running the command on the latter use:
user@aa6-100:~> rsync -av 'ecgate:${HOME/home/perm}/mydataset' $PERM/
The single quotes are needed here to ensure the $HOME variable takes its value on the remote rather than the local host.