back to : OS (Object Storage / S3)
Rclone
The …
install / update
Install and update process is described here : https://rclone.org/install/
In shared environments, like ``pier23``, ``jumphost-17`` where you do not have a root privileges install / update process is very similar, with exception that destination path where tool is installed need to be changed.
how to install rclone at jumphost-17
mkdir -p ~/.local/bin
cd /tmp
curl -O https://downloads.rclone.org/rclone-current-linux-amd64.zip
unzip rclone-current-linux-amd64.zip
cp rclone-*-linux-amd64/rclone ~/.local/bin/
chmod +x ~/.local/bin/rclone
rm -rf /tmp/rclone-current-linux-amd64.zip /tmp/rclone-*-linux-amd64
Add to file `~/.bashrc` line if not present :
export PATH="$HOME/.local/bin:$PATH"
how to update awscli at jumphost-17
Check a new version availability at https://downloads.rclone.org/, or https://github.com/rclone/rclone/releases . And repeat install procedure to overwrite old version.
configure rclone
mkdir -p ~/.config/rclone nvim ~/.config/rclone/rclone.conf
To be able to connect to CeNT's Object Store create a new secion (named 'cents3') in rclone.conf file
[cents3] type = s3 provider = Other env_auth = false access_key_id = YOUR_ACCESS_KEY secret_access_key = YOUR_SECRET_KEY endpoint = https://os.cent.uw.edu.pl force_path_style = true chunk_size = 64M upload_concurrency = 4 disable_checksum = false no_check_bucket = true
test rclone
To test if your setup is correct use bellow command. In output you should see list of bucket you have permission to use.
rclone lds cents3:
usage examples
In those examples I use rclone command on my workstation (PC).
I use debian images downloaded from page : https://cdimage.debian.org/debian-cd/current/amd64/iso-cd/
Target S3 backet name is itdep-test-0002.
copy single file
…
copy single file, with path
…
copy folder
…
list bucket content, single object
…
list bucket content, multiple object
…