Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Reverted from v. 2

...

4. Finalize provisioning steps.

Once submit node is up:

  • ssh into your machine
  • create a simple job
Code Block
# dockertest.sub -- example docker job

universe                = docker
docker_image            = debian
executable              = /bin/cat
arguments               = /etc/hosts
should_transfer_files   = YES
when_to_transfer_output = ON_EXIT
log                     = log/job_$(Process)_sleep.log
output                  = output/job_$(Process)_output.txt
error                   = error/job_$(Process)_errors.txt

request_cpus   = 1
request_memory = 1024M
request_disk   = 10240K

queue 10
  • use condor_submit <job_name>
  • verify jobs are running, using condor_q command

Once execute node is up:

  • ssh into your submit node
  • check if the node appears in the list of execute nodes, running condor_status

Docker universe job in HTCondor

...

Singularity job in HTCondor

Since May 2025, EWC HTC batch processing introduced the possibility to run singularity jobs. Singularity (https://sylabs.io/singularity/) is a container runtime system popular in scientific and HPC communities. HTCondor can run jobs inside Singularity containers.

Warning

Submit nodes created before April 2025, will fail when trying to run singularity jobs. In order to enable running singularity jobs, you need to deploy a new submit node as explained above.

...