Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Where do you access the ECaccess web interface?

    Expand
    titleSolution - If you have a local ECaccess gateway

    In a terminal session on ECS or HPC at ECMWF, you can run the command:

    No Format
    ecaccess-gateway-list

    This will show you all the ECaccess gateways installed. If you can see one ECaccess gateway installed at your local site, you can point your local browser to its URL.


    Expand
    titleSolution - If no local gateway available

    You can access the ECaccess web interface on http://boaccess.ecmwf.int/


  2. How to access ECMWF via ECaccess through sftp


    Expand
    titleSolution - If you have a local ECaccess gateway

    In a local terminal session at your site you can run the command:

    No Format
    sftp <gateway<your_ecmwf_user>@<gateway_name>

    You will see the different ECMWF 'file systems', a.k.a. domains, available to you.


    Expand
    titleSolution - If no local gateway available

    In a local terminal session at your site you can run the command:

    No Format
    sftp boaccess<your_ecmwf_user>@boaccess.ecmwf.int

    You will see the different ECMWF 'file systems', a.k.a. domains, available to you.


...

  1. How to list, upload, remove a file in $SCRATCH

    Expand
    titleSolution - you will more likely use this option on a local system at your site.

    In a terminal session, you can run the commands:

    No Format
    cd
    ecaccess-file-dir scratch:
    ecaccess-file-put <local_file> scratch:
    ecaccess-file-dir scratch:<local_file>
    ecaccess-file-delete scratch:<local_file>
    ecaccess-file-dir scratch:<local_file>

    where <local_file> is any file available in your current working directory.


...

  1. How to submit, monitor, cancel a job through ECaccess

    Expand
    titleSolution - again, you are more likely to use this option on a local system at your site.

    In a terminal session, you can run the commands:

    No Format
    ecaccess-queue-list
    ecaccess-queue-list ecs
    ecaccess-job-submit -help
    ecaccess-job-submit -queue ecs my_slurm_job.cmd
    ecaccess-job-list [ECaccess_Job_Id]
    ecaccess-job-delete <ECaccess_Job_Id>

    Where 'my_slurm_job.cmd' is a SLURM job in your current working directory and ECaccess_Job_Id is the ECaccess job ID returned to you when you submitted the job.

    Note that ECaccess has its own batch job scheduling system. It can submit a job to different computing systems, possibly running different batch workload managers. The command 'ecaccess-queue-list' will show you which computing systems and which batch workload managers are available.


...

  1. How to setup an ectrans association?

    Expand
    titleSolution - Setting un the ectrans association

    In a terminal session, either at your local site, if the web Toolkit is installed, or at ECMWF on ECS or HPC, you can run the commands:

    No Format
    ecaccess-association-list
    ecaccess-association-get -template ectrans_ecmwf_$USER ectrans_ecmwf_$USER.txt
    vi ectrans_ecmwf_$USER.txt

    You will have to update the main parameters given below, to point to the destination system where you wnat to transfer files to, e.g.:

    No Format
    ##############################################################
    # Main Parameters
    ##############################################################
    $name='ectrans_ecmwf_<user>';
    $active='yes';
    $comment='transfers from ecmwf';
    $grantedUserList='';
    $directory='./files_from_ecmwf';
    $hostName='my_local_hostname.meteo.mfms';
    $login='my_local_UIDuser';
    $protocol='genericFtp';

    Note that the login requested is your login on the system (hostName) where you will transfer files to.

    The Protocol will usually be genericFtp or genericSftp. Once the association is defined, you should push it to the ECaccess gateway with, e.g.:

    No Format
    ecaccess-association-put -password ectrans_ecmwf_$USER.txt
    ecaccess-association-list



  2. How to use ectrans?

    Expand
    titleSolution - Using ectrans

    In a terminal session, on ECS or HPC, you can run the commands:

    No Format
    ectrans -help
    ectrans -remote ectrans_ecmwf_$USER -source <local_file> -verbose
    ecaccess-ectrans-list [Ectrans_Id]

    where Ectrans_Id is the ectrans Identifier returned to you, when running ectrans (in asynchronous mode). If the transfer fails, see for what reason it failed. You may need to update the association used and push it back to ECaccess, before restarting the ectrans transfer:

    No Format
    ecaccess-ectrans-restart <Ectrans_Id>



...

  1. How to submit a TC-1 job?

    Expand
    titleSolution - Submitting a TC-1 job

    In a terminal session, either at your local site, if the web Toolkit is installed or at ECMWF, on ECS or HPC, you can run the commands:

    No Format
    ecaccess-event-list
    ecaccess-event-list ef12h240metgram

    At ECMWF, You you can take a copy of all the sample SLURM jobs, including the realtime meteogram job, with:

    No Format
    git clone ssh://git@git.ecmwf.int/uss/example_jobs.git
    vi example_jobs/atos_examples/realtime_metgram.cmd

    You should adapt the sample job to your requirements. Note that you will have to update the SLURM '#SCRATCH -chdir=' directive. You can now submit the job, e.g. with:

    No Format
    ecaccess-job-submit -queueName ecs -eventIds ef12h240metgram example_jobs/atos_examples/realtime_metgram.cmd
    ecaccess-job-list

    The TC-1 job just submitted should be in 'Standby' mode. It will run when the 10-days realtime ENS meteograms for the 12Z run are available. 

    If you no longer want one of youir your TC-1 jobs to run , or if you need to make a correction to the job, you will have to remove the relevant ECaccess job in Standby mode, with 'ecaccess-job-delete'. If wanted, you can then adapt the job and resubmit it.