tips/using Amazon Glacier
git-annex
http://git-annex.branchable.com/tips/using_Amazon_Glacier/
git-annex
ikiwiki
2015-12-08T15:14:06Z
missing steps?
http://git-annex.branchable.com/tips/using_Amazon_Glacier/comment_1_ccee7f4f5a483a3650270b6e09ab7293/
greg
2014-02-18T23:51:01Z
2014-02-18T23:51:00Z
<p>I setup a glacier remote on one machine and it successfully created the vault and is syncing files to it.</p>
<p>One another machine, after git-annex sync'ing, I did:</p>
<div class="highlight-sh"><pre class="hl">greg@x200s<span class="hl opt">:</span>~<span class="hl opt">/</span>Photos$ git-annex enableremote glacier
enableremote glacier
Set both AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY to use glacier
git-annex<span class="hl opt">:</span> Failed creating glacier vault.
</pre></div>
<p>So then I try:</p>
<div class="highlight-sh"><pre class="hl">greg@x200s<span class="hl opt">:</span>~<span class="hl opt">/</span>Photos$ AWS_ACCESS_KEY_ID<span class="hl opt">=</span>HAHA AWS_SECRET_ACCESS_KEY<span class="hl opt">=</span>NOPE git-annex <span class="hl kwb">--debug</span> enableremote glacier
<span class="hl opt">[</span><span class="hl num">2014</span><span class="hl kwb">-02-18</span> <span class="hl num">15</span><span class="hl opt">:</span><span class="hl num">43</span><span class="hl opt">:</span><span class="hl num">56</span> PST<span class="hl opt">]</span> <span class="hl kwb">read</span><span class="hl opt">:</span> git <span class="hl opt">[</span><span class="hl str">"--git-dir=/home/greg/Photos/.git"</span><span class="hl opt">,</span><span class="hl str">"--work-tree=/home/greg/Photos"</span><span class="hl opt">,</span><span class="hl str">"show-ref"</span><span class="hl opt">,</span><span class="hl str">"git-annex"</span><span class="hl opt">]</span>
<span class="hl opt">[</span><span class="hl num">2014</span><span class="hl kwb">-02-18</span> <span class="hl num">15</span><span class="hl opt">:</span><span class="hl num">43</span><span class="hl opt">:</span><span class="hl num">56</span> PST<span class="hl opt">]</span> <span class="hl kwb">read</span><span class="hl opt">:</span> git <span class="hl opt">[</span><span class="hl str">"--git-dir=/home/greg/Photos/.git"</span><span class="hl opt">,</span><span class="hl str">"--work-tree=/home/greg/Photos"</span><span class="hl opt">,</span><span class="hl str">"show-ref"</span><span class="hl opt">,</span><span class="hl str">"--hash"</span><span class="hl opt">,</span><span class="hl str">"refs/heads/git-annex"</span><span class="hl opt">]</span>
<span class="hl opt">[</span><span class="hl num">2014</span><span class="hl kwb">-02-18</span> <span class="hl num">15</span><span class="hl opt">:</span><span class="hl num">43</span><span class="hl opt">:</span><span class="hl num">56</span> PST<span class="hl opt">]</span> <span class="hl kwb">read</span><span class="hl opt">:</span> git <span class="hl opt">[</span><span class="hl str">"--git-dir=/home/greg/Photos/.git"</span><span class="hl opt">,</span><span class="hl str">"--work-tree=/home/greg/Photos"</span><span class="hl opt">,</span><span class="hl str">"log"</span><span class="hl opt">,</span><span class="hl str">"refs/heads/git-annex..8108714116d08f93aa427b9ddced48cd5f2b4b72"</span><span class="hl opt">,</span><span class="hl str">"--oneline"</span><span class="hl opt">,</span><span class="hl str">"-n1"</span><span class="hl opt">]</span>
<span class="hl opt">[</span><span class="hl num">2014</span><span class="hl kwb">-02-18</span> <span class="hl num">15</span><span class="hl opt">:</span><span class="hl num">43</span><span class="hl opt">:</span><span class="hl num">56</span> PST<span class="hl opt">]</span> <span class="hl kwb">read</span><span class="hl opt">:</span> git <span class="hl opt">[</span><span class="hl str">"--git-dir=/home/greg/Photos/.git"</span><span class="hl opt">,</span><span class="hl str">"--work-tree=/home/greg/Photos"</span><span class="hl opt">,</span><span class="hl str">"log"</span><span class="hl opt">,</span><span class="hl str">"refs/heads/git-annex..742ba908f791e440a6cc85073ef505a96dd66aa4"</span><span class="hl opt">,</span><span class="hl str">"--oneline"</span><span class="hl opt">,</span><span class="hl str">"-n1"</span><span class="hl opt">]</span>
<span class="hl opt">[</span><span class="hl num">2014</span><span class="hl kwb">-02-18</span> <span class="hl num">15</span><span class="hl opt">:</span><span class="hl num">43</span><span class="hl opt">:</span><span class="hl num">56</span> PST<span class="hl opt">]</span> <span class="hl kwb">read</span><span class="hl opt">:</span> git <span class="hl opt">[</span><span class="hl str">"--git-dir=/home/greg/Photos/.git"</span><span class="hl opt">,</span><span class="hl str">"--work-tree=/home/greg/Photos"</span><span class="hl opt">,</span><span class="hl str">"log"</span><span class="hl opt">,</span><span class="hl str">"refs/heads/git-annex..071487394544a20253a70ada4ea71fcc28f9fc13"</span><span class="hl opt">,</span><span class="hl str">"--oneline"</span><span class="hl opt">,</span><span class="hl str">"-n1"</span><span class="hl opt">]</span>
<span class="hl opt">[</span><span class="hl num">2014</span><span class="hl kwb">-02-18</span> <span class="hl num">15</span><span class="hl opt">:</span><span class="hl num">43</span><span class="hl opt">:</span><span class="hl num">56</span> PST<span class="hl opt">]</span> <span class="hl kwb">read</span><span class="hl opt">:</span> git <span class="hl opt">[</span><span class="hl str">"--git-dir=/home/greg/Photos/.git"</span><span class="hl opt">,</span><span class="hl str">"--work-tree=/home/greg/Photos"</span><span class="hl opt">,</span><span class="hl str">"log"</span><span class="hl opt">,</span><span class="hl str">"refs/heads/git-annex..c8aecc22da7b84bbb82f083ce783cc699cef1c67"</span><span class="hl opt">,</span><span class="hl str">"--oneline"</span><span class="hl opt">,</span><span class="hl str">"-n1"</span><span class="hl opt">]</span>
<span class="hl opt">[</span><span class="hl num">2014</span><span class="hl kwb">-02-18</span> <span class="hl num">15</span><span class="hl opt">:</span><span class="hl num">43</span><span class="hl opt">:</span><span class="hl num">56</span> PST<span class="hl opt">]</span> chat<span class="hl opt">:</span> git <span class="hl opt">[</span><span class="hl str">"--git-dir=/home/greg/Photos/.git"</span><span class="hl opt">,</span><span class="hl str">"--work-tree=/home/greg/Photos"</span><span class="hl opt">,</span><span class="hl str">"cat-file"</span><span class="hl opt">,</span><span class="hl str">"--batch"</span><span class="hl opt">]</span>
enableremote glacier <span class="hl opt">[</span><span class="hl num">2014</span><span class="hl kwb">-02-18</span> <span class="hl num">15</span><span class="hl opt">:</span><span class="hl num">43</span><span class="hl opt">:</span><span class="hl num">56</span> PST<span class="hl opt">]</span> call<span class="hl opt">:</span> glacier <span class="hl opt">[</span><span class="hl str">"--region=us-west-2"</span><span class="hl opt">,</span><span class="hl str">"vault"</span><span class="hl opt">,</span><span class="hl str">"create"</span><span class="hl opt">,</span><span class="hl str">"glacier-7e5c0010-2634-4a5e-bc7b-6fea84b8b947"</span><span class="hl opt">]</span>
git-annex<span class="hl opt">:</span> Failed creating glacier vault.
</pre></div>
<p>What am I missing?</p>
<p>Also, why is it trying to <em>create</em> the valut? It's already there with content in it!</p>
comment 2
http://git-annex.branchable.com/tips/using_Amazon_Glacier/comment_2_d34e05f9244d3a4fcec87b3c360adb4e/
joeyh.name
2014-02-20T19:24:09Z
2014-02-20T19:24:09Z
<p>@greg, the only thing you might have missed is the need to use <code>glacier vault sync</code> to build a cache if enabling the glacier remote in another place. And that whole issue with it needing a local cache may mean few people are using glacier with more than one repository accessing the remote.</p>
<p>However, this sounds like a bug. There is a comment in the source code that "glacier vault create will succeed even if the vault already exists." .. perhaps it has changed since that was written. Or perhaps the command failed for some other reason, I don't know.</p>
comment 3
http://git-annex.branchable.com/tips/using_Amazon_Glacier/comment_3_4c504fd22775afe36296cf54d3e04a8e/
joeyh.name
2014-02-20T19:34:48Z
2014-02-20T19:34:48Z
I've changed it to avoid running glacier value create when enabling an existing glacier remote. Hopefully that fixes it.
comment 4
http://git-annex.branchable.com/tips/using_Amazon_Glacier/comment_4_e6ac76b0c20285f4f96b3d0975e8ac66/
greg
2014-02-20T22:04:58Z
2014-02-20T22:04:58Z
<p>Along with stupid python problems which are now fixed (all my fault, and hopefully didn't cause more noise here than needed), the only thing that didn't go as stated was:</p>
<div class="highlight-sh"><pre class="hl">greg@x200s<span class="hl opt">:</span>~<span class="hl opt">/</span>Photos$ git-annex enableremote glacier
enableremote glacier
Set both AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY to use glacier
git-annex<span class="hl opt">:</span> Failed creating glacier vault.
greg@x200s<span class="hl opt">:</span>~<span class="hl opt">/</span>Photos$ AWS_ACCESS_KEY_ID<span class="hl opt">=</span>lolno AWS_SECRET_ACCESS_KEY<span class="hl opt">=</span>lolno git-annex enableremote glacier
enableremote glacier ok
<span class="hl opt">(</span>Recording state <span class="hl kwa">in</span> git...<span class="hl opt">)</span>
greg@x200s<span class="hl opt">:</span>~<span class="hl opt">/</span>Photos$
</pre></div>
<p>The guide says that info is sync'd.</p>
good
http://git-annex.branchable.com/tips/using_Amazon_Glacier/comment_5_7788890f58f714b0cdf1462c718ea536/
joeyh.name
2014-02-21T15:20:40Z
2014-02-21T15:20:39Z
If you mean the creds are not remembered, that's controlled by the embedcreds= option to initremote, and it only defaults to embedding them for gacier when using strong encryption (not encryption=shared).
confirmed
http://git-annex.branchable.com/tips/using_Amazon_Glacier/comment_6_0fbe528a57552622e8128196ad80c863/
greg
2014-02-21T17:53:02Z
2014-02-21T17:53:02Z
Yeah, I choose no encryption for this one for worst case scenario reasons (I still want photos of my kid even if I loss my gpg key and my house burns down). Now about setting up http://git.kitenet.net/?p=gpg.git;a=blob;f=README.sss;hb=HEAD ......
Problems initializing glacier remote
http://git-annex.branchable.com/tips/using_Amazon_Glacier/comment_7_a83cfe55f4c70bd8801e0c05c5be8323/
ben
2015-12-08T10:39:30Z
2015-12-08T10:39:30Z
<p>Hi, when I try to create a glacier remote, the command freezes without further output:</p>
<pre><code>$ git init
$ git annex init
$ git annex initremote glacier type=glacier keyid=xxxxxxxx
initremote glacier (encryption setup)
</code></pre>
<p>I can see the following processes in sleep state:</p>
<pre><code>11438 pts/0 S+ 0:00 git --git-dir=/home/b/Documents/annex/.git --work-tree=/home/b/Documents/annex cat-file --batch
11440 pts/0 SL+ 0:00 gpg2 --batch --no-tty --use-agent --quiet --trust-model always --gen-random --armor 2 512
</code></pre>
<p>I'm on fedora 22, git-annex version: 5.20140717. Any suggestions appreciated, thanks!</p>
comment 8
http://git-annex.branchable.com/tips/using_Amazon_Glacier/comment_8_ddef6cc5d1a5fd3d69cfe8cccfa58a53/
joey
2015-12-08T15:14:06Z
2015-12-08T15:12:59Z
<p>@ben, it's generating the encryption key, and is blocked waiting on enropy.
You can pass --fast to use lower-quality randomness.</p>