For using Google Cloud Storage as a special remote, there are currently three choices:
Google Cloud Storage supports supports the same API as Amazon S3, so git-annex's built-in S3 special remote can be used with it. You may need to configure Google Cloud Storage to allow "Interoperable Access". Here is how to set up the special remote:
git annex initremote cloud type=S3 encryption=none host=storage.googleapis.com port=80
Alternatively, rclone supports Google Cloud Storage's native API, so the rclone special remote can be used.
Alternatively, there is a dedicated special remote, https://github.com/bgilbert/gcsannex
(Last updated 2016)
At this time it's not clear which is better, so if you find one works best, please comment below.
This looks very valuable - Google are offering a free 5GB up until 2013 June 30th
Sign in here[1] get your credentials here[2] under the section “Interoperable Access” (Source[3])
According to the last comment, and this page: * https://developers.google.com/storage/docs/migrating#keys
there's supposed to be a "Interoperable Access" menu option, something I can't find. Note that both the previous comment and this page refers to Googles old Developer Console.
I can find a few things under "APIs and Auth" => "Credentials" under the heading "Public API access", but no matter what kind of key I try to create I can't get anything other than an API key. No secrets here, and no "Show"-button for newly created keys.
Another thing worth mentioning is that these API keys I'm seeing do not like described in that first link in this comment. It's much longer, contains both upper- and lowercase and also contains dashes.
I just found the "Interoperable access" thing. The instructions from Google (linked in previous comments) are not perfect.
After step 4 click "Google Cloud Storage", then at the bottom you have a heading called "Interoperable Access" where you have to activate it for this project.
Then it appears at the bottom of the left hand menu.
Nice job bgilbert on the external special remote.
git-annex's S3 special remote also supports nearline now:
For the nearline support to work, git-annex has to be built with version 0.13.0 of the haskell aws library.
But, it seems like bgilbert's external special remote is easier to set up, due to not needing to configure Google Cloud Storage for interoperable access.
When trying to use google cloud storage i get the following error:
Does anybody know what is causing this? I am pretty sure that the credentials are correctly set and ommiting storageclass=NEARLINE does not help.
@Dosenpfand at a guess, perhaps you have missed enabling "Interoperable Access" in google cloud storage?
Or, maybe Google managed to break their S3 compatability..
gcsannex is probably a better way to tie git-annex and GCS together than using the S3 interface.