Pre-requisites
EWC EUMETSAT S3 endpoint URL is: https://s3.waw3-1.cloudferro.com
EWC ECMWF S3 endpoint URLs:
- CCI1 cluster : https://object-store.os-api.cci1.ecmwf.int
- CCI2 cluster : https://object-store.os-api.cci2.ecmwf.int
For private buckets you need the access keys to your S3 bucket ready. Typically you'll find your access key and secret key in Morpheus under Tools -> Cypher.
CLI libraries
Some of the CLI libraries that can be used to access s3 buckets are described below:
- Object storage: How to use rclone → Rclone is a command-line program to move/synchronise files from one storage location to another - for those familiar with rsync, rclone is rsync for cloud and more. Additionally, Rclone mounts any local, cloud or virtual filesystem as a disk on Windows, macOS, linux and FreeBSD, and also serves these over SFTP, HTTP, WebDAV, FTP and DLNA. Rclone is mature, open-source software originally inspired by rsync and written in Go.
- s3cmd → S3cmd is a free command line tool and client for uploading, retrieving and managing data in cloud storage service providers that use the S3 protocol. It is best suited for power users who are familiar with command line programs. It is also ideal for batch scripts and automated backup to S3, triggered from cron, etc.
- Object storage: How to use awscli → command-line for s3 buckets.
You can find more details using the following pages: