This system allows users to automatically submit jobs to be run when certain points in the daily ECMWF operational forecast suite have been reached. The main purpose is to ensure that certain data is available before e.g. submitting a MARS request. This facility is running using the ECaccess environment. It is available either through the Web interface of ECaccess or with the ECaccess ECaccess Web Toolkit available at ECMWF on ecgate or the HPCs or installed locally.
...
The jobs are to be submitted via ECaccess. Events, also known as notifications, have been added to ECaccess. These events correspond to the different stages when the ECMWF operational activity has produced certain data or products. When submitting your job through ECaccess, users will have to specify to which events they want to attach these jobs. When using the web interface, the list of events available to the user will be shown when submitting a new job. If you use the ECaccess Web Toolkit, the command ecaccess-event-list will show you the list of events. The command ecaccess-job-submit will be used to submit your job.
...
Note that the jobs submitted through ECaccess will be kept in the ECaccess spool. Jobs attached to one event of the ECMWF operational suite will remain in standby mode in ECaccess up until they are submitted to the batch service , e.g. Slurm on ecgate. The job and job output files can be retrieved using the ECaccess command ecaccess-job-get.
We offer job rerunning facilities. If one job fails, you can ask ECaccess to rerun your job.
...
Summary
- Take your existing batch job.
- Optionally, remove the batch directives redirecting the job output and error files, to allow the operators to see these files.
- For your convenience, make use of the dynamic environmental variables starting with
MSJ_. - Optionally, include the "
set -e" command, to notify the correct status to ECaccess and the monitoring interface. - Check the events available with the command ecaccess-event-list.
- Submit your job to ECaccess and attach it to the appropriate event, using the ECaccess web interface or the
ecaccess-job-submitcommand. - If you have to correct your job, you should delete the job (ecaccess-job-delete) in standby mode and resubmit the new version.
- For further guidance please have a look at the realtime_metgram batch job example, which allows you to create various types of meteograms.
...