Repeat steps 3a-4 to 3a-9 for each dataset you want to backup to B2. Step 4: Configuring rclone. Run rclone config to initiate the configuration of rclone; Press n to create a new remote (a remote is what rclone uses to know where to copy/sync your files). Enter a name, I choose b2. Enter your account ID from your B2 account. 'rsync for cloud storage' - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files - Hsury/rclone.
I've finished the first version of rclone integration (seehttp://rclone.org and http://github.com/ncw/rclone ).
rclone aims to be 'rsync for cloud storage' - a command line tool justaimed at the mechanics of transporting files between cloud storagesystems and the local disk.
Here are some notes on where I found parts of the API which could bechanged to make rclone's life easier. I marked the ones I'd reallylike changed with IMPORTANT - the rest are general comments.
Make X-Bz-Content-Sha1 be optional in b2_upload_file
rclone works on a streaming basis (because it can transfer filesbetween cloud storage systems) and having to have the SHA1 of the filebefore it has been uploaded means rclone has to make a temporary copyof files if not transferring from disk or a cloud storage system thatsupports SHA1 natively.
If X-Bz-Content-Sha1 was made optional rclone would accumulate thesha1 as it went along, read the value from the returned sha1 anddelete the file if it was incorrect.
IMPORTANT for rclone not to thrash the users disk when doing cloud tocloud copies. rclone doesn't have to do this when uploading filesfrom the local disk any more so this is much less important than it was.
UPDATE a fix for this is in progress :-)
Can't set new fileInfo without uploading a file
It would be really useful to have an API to set the fileInfo withoutuploading a file.
Somewhat analagous to b2_get_file_info - say b2_set_file_info.
Without this rclone can't support its full range of syncing options asit can't update the modified time on an already uploaded object.
IMPORTANT for rclone to update the modified date on an existingobject without uploading the file again.
Rclone Backblaze B2
Provide API to look up a bucket ID from bucket name
Rclone To Backblaze B2
The only way to do this at the moment is to call b2_list_buckets whichpotentially might be up to 100 buckets (maybe more in the future?).
Alternatively the list buckets API could take a startBucketName anda maxBucketCount like b2_list_file_names.
Unify inconsistent representations of a file
FIXED :-)
URL encoding inconsistency
FIXED :-)
Would like b2_get_file_info_name
A b2_get_file_info_name method would be helpful which would be the same as b2_get_file_info but allowyou to pass in the name of a file.
I've worked around this by using b2_list_file_names and setting astartFileName and a maxFileCount of 1.