Table of Contents

back to : OS (Object Storage / S3)

Rclone

The …

install / update

Install and update process is described here : https://rclone.org/install/

In shared environments, like ``pier23``, ``jumphost-17`` where you do not have a root privileges install / update process is very similar, with exception that destination path where tool is installed need to be changed.

how to install rclone at jumphost-17

mkdir -p ~/.local/bin                                                
cd /tmp                                       
                                       
curl -O https://downloads.rclone.org/rclone-current-linux-amd64.zip
   
unzip rclone-current-linux-amd64.zip
cp rclone-*-linux-amd64/rclone ~/.local/bin/
chmod +x ~/.local/bin/rclone
                                       
rm -rf /tmp/rclone-current-linux-amd64.zip /tmp/rclone-*-linux-amd64

Add to file `~/.bashrc` line if not present :

export PATH="$HOME/.local/bin:$PATH"

how to update awscli at jumphost-17

Check a new version availability at https://downloads.rclone.org/, or https://github.com/rclone/rclone/releases . And repeat install procedure to overwrite old version.

configure rclone

mkdir -p ~/.config/rclone
nvim ~/.config/rclone/rclone.conf

To be able to connect to CeNT's Object Store create a new secion (named 'cents3') in rclone.conf file

[cents3]
type = s3
provider = Other
env_auth = false                                                          
access_key_id = YOUR_ACCESS_KEY
secret_access_key = YOUR_SECRET_KEY
endpoint = https://os.cent.uw.edu.pl
force_path_style = true
chunk_size = 64M
upload_concurrency = 4
disable_checksum = false
no_check_bucket = true

test rclone

To test if your setup is correct use bellow command. In output you should see list of bucket you have permission to use.

rclone lds cents3:

usage examples

In those examples I use rclone command on my workstation (PC).

I use debian images downloaded from page : https://cdimage.debian.org/debian-cd/current/amd64/iso-cd/

Target S3 backet name is itdep-test-0002.

copy single file

…

copy single file, with path

…

copy folder

…

list bucket content, single object

…

list bucket content, multiple object

…

remove object

…


back to : OS (Object Storage / S3)