Wasabi 'Buckets' are additional storage that can be mounted within a virtual machine - or in this case, a DigitalOcean Droplet. Once mounted, a bucket looks the same as a directory (or folder). By all appearances it's a local folder, but in reality it's a virtual mirror of a folder that is located elsewhere and connected through the internet. With these sorts of connections (or mounts) you may notice a little bit of lag when opening and accessing folders since they are not local to the virtual machine. Whether or not this affects your use case is easy to test because Wasabi provides trial access to their services for 30 days free and 1TB of storage. The following are the steps that I followed to set up a Wasabi Bucket inside of a DigitalOcean Droplet with Ubuntu 18.04. The information is also gradually being updated and added to, so it may seem a bit bare through the holidays.

Create wasabi access key with secret key

To generate a wasabi access key, login to your wasabi account and generate one under "Access Keys". Be sure to download the credentials.csv file as it has your key ID and secret key.

# Create access key file
echo [YOUR_WASABI_ACCESS_KEY_ID]:[YOUR_WASABI_SECRET_ACCESS_KEY] > ~/.pwd-s3fs 
chmod 600 /etc/pwd-s3fs

Uninstall and reinstall s3fs

### Ubuntu Systems ### 
sudo apt-get update
sudo apt-get remove fuse

### Ubuntu Systems ### 
sudo apt-get install build-essential libcurl4-openssl-dev libxml2-dev mime-support

sudo apt install s3fs

Create directories and mount wasabi storage

  • -0 nonempty: the current directory is not empty
  • -0 allow_other: do not restrict access to mount to just root
sudo vim /etc/fuse.conf
# uncomment the following:
user_allow_other
# Make temporary cache directory and the desired mount
mkdir /tmp/cache /opt/mytardis/mydata_storage

# give these directories open read-write access
chmod 777 /tmp/cache /opt/mytardis/mydata_storage

# mount your wasabi storage bucket 
# take note that "mytardis-mydata" is the name of my wasabi bucket
sudo s3fs mytardis-mydata /opt/mytardis/mydata_storage -o passwd_file=/etc/passwd-s3fs -o url=https://s3.wasabisys.com -o nonempty -o allow_other 

## setup MyData directories
su tardis
# -p recursively makes directories
sudo mkdir -p /opt/mytardis/mydata_storage/receiving
sudo mkdir -p /opt/mytardis/mydata_storage/complete

fstab here to remount on boot

  • steps soon

RClone rsync wasabi bucket on a schedule with cron to TACC Virtual Machine

  • steps soon

S3 Storage + Django config