...
| Info |
|---|
it works for public and private buckets after configuration |
rclone is an immensely powerful tool for copying and synchronising data from one location to another - here we only consider object storage, but it is capable of far more. See the rclone website & documentation linked at the bottom of this page.
Configure rclone
Interactive rclone configuration
...
acl : select the one that best fits your use case
Finalize it and save
Manual configuration
Edit ~/.config/rclone/rclone.conf with your editor of choice and insert a block like this:
| Code Block |
|---|
[EWC-objectstorage]
type = s3
provider = Other
env_auth = false
endpoint = https://s3.waw3-1.cloudferro.com
access_key_id = ACCESS
secret_access_key = HUNTER2 |
Putting your own access and secret keys in the appropriate fields.
You should then be able to perform basic commands as below, e.g. rclone ls EWC-objectstorage:bucketname/path/
Basic commands with rclone
...
rclone mkdir is used to create a directory on the path you want in your bucket. Note that the concept of a directory isn't entirely real on object storage - see https://medium.com/datamindedbe/the-mystery-of-folders-on-aws-s3-78d3428803cb for a good explanation.
| Code Block |
|---|
rclone mkdir <REMOTE_NAME>:<PATH_DIRECTORY> |
...
rclone lsd is used to list directories in the remote. This is also useful for seeing what buckets are on the remote (only the ones you created with these credentials - there may be others you didn't create but were granted access to)
| Code Block |
|---|
rclone lsd <REMOTE_NAME>: |
...
rclone copy is used to copy files or whole directory structures from your local machine to the remote bucket. It's very similar to rsync -av and mirrors the local structure up to the remote, only copying when there are differences.
Consider copying a file to remote:
...
where SOURCE_DIRECTORY is a local directory with files you want to sync to remote. This is similar to copy, but also deletes files on the remote that aren't present on the local directory (e.g. like rsync -av --delete )
Advanced commands with rclone
...