You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

Currently in beta testing and supported on a best-effort basis.


Deployment via Morpheus UI (deprecated)

This method of deployment is deprecated, and kept in documentation only as reference for  EUMETSAT tenancies that relied on it prior to December of 2026.

Pre-requisite

Before deploying an HTcondor node, you need to create an htcondor specific security group. You can follow this page: Morpheus Legacy: Creating Security Groups to know how to create security groups.

  • htcondor security group with the following rules:

Rule name

Direction

Rule Type

Protocol

Port Range

Source Type

Source

Destination Type

9618-tcp

ingress

Custom Rule

TCP

9618

Network

100.64.0.0/10

Instance


Deploy execute or submit node

1. Go to Provisioning → Instances and click on Add+ to add a new instance

2. Select Htcondor Submit/Execute node

3. Fill data required:

  • plan: choose your plan
  • network: private
  • security group: htcondor, ssh (only for submit node

4. Finalize provisioning steps.


Once submit node is up:

  • ssh into your machine
  • create a simple job
# dockertest.sub -- example docker job

universe                = docker
docker_image            = debian
executable              = /bin/cat
arguments               = /etc/hosts
should_transfer_files   = YES
when_to_transfer_output = ON_EXIT
log                     = log/job_$(Process)_sleep.log
output                  = output/job_$(Process)_output.txt
error                   = error/job_$(Process)_errors.txt

request_cpus   = 1
request_memory = 1024M
request_disk   = 10240K

queue 10
  • use condor_submit <job_name>
  • verify jobs are running, using condor_q command


Once execute node is up:

  • ssh into your submit node
  • check if the node appears in the list of execute nodes, running condor_status

Docker universe job in HTCondor

Try this tutorial on how to create a container and push it to a registry using docker. Moreover it provides an example job that can be submitted to HTCondor. If you cannot use public container registry, you can use EUMETSAT - Container Registry for HTC Batch Processing and Kubernetes specifically added for this purpose mainly.


Singularity job in HTCondor

Since May 2025, EWC HTC batch processing introduced the possibility to run singularity jobs. Singularity (https://sylabs.io/singularity/) is a container runtime system popular in scientific and HPC communities. HTCondor can run jobs inside Singularity containers.

Submit nodes created before April 2025, will fail when trying to run singularity jobs. In order to enable running singularity jobs, you need to deploy a new submit node as explained above.

Try this tutorial example job that can be submitted to HTCondor. 



  • No labels