For simplicity of setup, we recommend you deploy our designated EWC Community Hub Item onto an existing VM where you wish to access data from. Please refer to the EUMETSAT S3 Mount Flavour for details.

Access to the archive is read-only.

Only a limited subset of EUMETSAT data is available. Please contact the EWC support if the dataset you require is not listed here.

Following describes how to mount EUMETSAT data buckets as FUSE mounts. The possibility to mount the buckets into as filesystem is provided to as convenience. Readers are advised to note that mounting buckets via FUSE will provide significantly worse performance than accessing the data directly from workloads, for example using python.  Whenever possible, users are advised to use the buckets directly from the workloads.


Manual mount

Following steps are using ASCAT data as an example. Please modify the commands to mount any other bucket. 

  1. Make sure you have latest rclone installed

    curl https://rclone.org/install.sh | sudo bash

  2. Create mount directory, i.e. for ascat:

    sudo mkdir -p /eumetsatdata/ascat && sudo chown -R $USER:$USER /eumetsatdata/ascat && chmod 755 /eumetsatdata/ascat

  3. Put rclone like listed below config into a config file. For example, into /etc/eum_bucket_creds (keys without brackets) 

    sudo sh -c "cat >>/etc/eum_bucket_creds <<-EOF
[eumetsat-ascat]
type = s3
provider = Ceph
endpoint = https://s3.waw3-1.cloudferro.com
EOF

  4. Now you can already mount the data with command:

    sudo rclone --config /etc/eum_bucket_creds mount --allow-other --daemon eumetsat-ascat:ascat.metop-abc.level-1b.native /eumetsatdata/ascat

Setting up a service

To have mount points available all the time and after reboots, one need to set up the service and add mount points into fstab.

  1. Link rclone

    sudo ln -s /usr/bin/rclone /sbin/mount.rclone

  2. Create systemd service:, for example for ascat:

    sudo sh -c "cat >>/etc/systemd/system/eum-data-ascat.service" <<-EOF
[Unit]
Description=Mount EUMETSAT data bucket ascat
After=network-online.target

[Mount]
Type=rclone
What=eumetsat-ascat:ascat.metop-abc.level-1b.native
Where=/eumetsatdata/ascat
Options=ro,allow_other,args2env,vfs-cache-mode=writes,config=/etc/eum_bucket_creds,cache-dir=/var/rclone,vfs-cache-max-size=512Mi,vfs-cache-poll-interval=30m'
EOF

  3. Add corresponding line into /etc/fstab:

    echo "eumetsat-ascat:ascat.metop-abc.level-1b.native /eumetsatdata/ascat rclone ro,noauto,nofail,x-systemd.automount,args2env,allow_other,vfs_cache_mode=writes,config=/etc/eum_bucket_creds,cache_dir=/var/cache/rclone,vfs-cache-max-size=512Mi,vfs-cache-poll-interval=30m 0 0" | sudo tee -a /etc/fstab

  4. Mount the folder:

    sudo mount /eumetsatdata/ascat