...
4. Finalize provisioning steps.
Once submit node is up:
- ssh into your machine
- create a simple job
| Code Block |
|---|
# dockertest.sub -- example docker job
universe = docker
docker_image = debian
executable = /bin/cat
arguments = /etc/hosts
should_transfer_files = YES
when_to_transfer_output = ON_EXIT
log = log/job_$(Process)_sleep.log
output = output/job_$(Process)_output.txt
error = error/job_$(Process)_errors.txt
request_cpus = 1
request_memory = 1024M
request_disk = 10240K
queue 10 |
- use condor_submit <job_name>
- verify jobs are running, using condor_q command
Once execute node is up:
- ssh into your submit node
- check if the node appears in the list of execute nodes, running condor_status
Docker universe job in HTCondor
Try this tutorialon how to create a container and push it to a registry using docker. Moreover it provides an example job that can be submitted to HTCondor. If you cannot use public container registry, you can use EUMETSAT - Container Registry for HTC Batch Processing and Kubernetes specifically added for this purpose mainly.
Singularity job in HTCondor
Since May 2025, EWC HTC batch processing introduced the possibility to run singularity jobs. Singularity (https://sylabs.io/singularity/) is a container runtime system popular in scientific and HPC communities. HTCondor can run jobs inside Singularity containers.
| Warning |
|---|
Submit nodes created before April 2025, will fail when trying to run singularity jobs. In order to enable running singularity jobs, you need to deploy a new submit node as explained above. |
Try this tutorialexample job that can be submitted to HTCondor.