forum/My first impressions after some weeks with git-annex assistantgit-annexhttp://git-annex.branchable.com/forum/My_first_impressions_after_some_weeks_with_git-annex_assistant/git-annexikiwiki2013-11-27T22:47:37Zcomment 1http://git-annex.branchable.com/forum/My_first_impressions_after_some_weeks_with_git-annex_assistant/comment_1_9d4019a54fb508e286a5d6d2660361d9/joey2013-11-27T22:47:37Z2013-04-23T21:41:31Z
<p>This is a lot of stuff. It would be better to file individual detailed bug reports if you want any of this looked at in depth. Otherwise, I just read it to get an impression of how things are working, or not, for you, and try to hit some of the main points:</p>
<ul>
<li><p>The OSX app icon behavior is probably because OSX does not realize that this is supposed to be a daemon. I don't know how to fix that. Clicking on the app icon is supposed to launch the web app, and has been reported to do so by others. I have no access to an OSX desktop.</p></li>
<li><p>Transfer repositories only keep files that have not yet reached all your client repositories. However, it's possible that files
may be uploaded to a transfer repository unnecessarily (if there is some other path for the file to get to the other client
repositories, ie if you've locally paired them). In this case, the file will be uploaded and then later removed from the transfer
repository, without being used.</p></li>
<li><p>I have never seen encrypted filenames appear in the webapp. I don't see how that could happen TBH.</p></li>
<li><p>git-annex logs information to <code>.git/annex/debug.log</code> within your repository. You can go to Configuration -> Preferences to enable
additional debug logging. I absolutely need these logs to help debug almost any problems with the assistant.</p></li>
<li><p>"Clicking a couple of hundred play buttons" could result in it trying to make a couple of hundred uploads to box.com
at the same time. This is probably not a good idea.</p></li>
<li><p>The fragment of log you posted shows me some problem that caused gpg to fail to encrypt a file before sending it to somewhere,
but it's lacking all context (and starts when the file transfer is already 87% complete!) so I can't say more. I need to see the whole log to make any informed guesses about what might be going on.</p></li>
</ul>
comment 2http://git-annex.branchable.com/forum/My_first_impressions_after_some_weeks_with_git-annex_assistant/comment_2_109534a45881ce94a4586c8a83945f9f/EmanueleAina2013-11-27T22:47:37Z2013-09-11T17:55:14Z
<p>I seem to hit the same issue (<code>ResponseTimeout</code>) on box.com, but I don't have any log file under .git/annex.</p>
<p>The timeout is quite unpredictable, sometimes I'm able to transfer less than 20% of the file while sometimes it fails after reaching 51%. The file is quite big, 6.2G.</p>
<p>Unfortunately, after the first upload fails, <code>git-annex</code> seems to think that the file has been uploaded successfully and will refuse to copy it again. Even <code>whereis</code> will list the box.com location.</p>
<p>I think there are really two bugs: the one triggering the timeouts, and the fact that <code>git-annex</code> thinks that the failing upload succeeded and is unable to recover the interrupted upload.</p>
<p>Here's the log I got on the shell. Let me know how I can provide any additional information needed. Thanks!</p>
<pre><code>$ git annex copy --verbose --debug home.tar.gz --to box.com
[2013-09-11 17:42:52 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","show-ref","git-annex"]
[2013-09-11 17:42:52 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","show-ref","--hash","refs/heads/git-annex"]
[2013-09-11 17:42:52 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","log","refs/heads/git-annex..1e029f92c5c82b094cbe70b55927996c31579e2e","--oneline","-n1"]
[2013-09-11 17:42:52 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","log","refs/heads/git-annex..1090c21b121fd8b6e2ab49a772c8eab5235a3930","--oneline","-n1"]
[2013-09-11 17:42:52 CEST] chat: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","cat-file","--batch"]
[2013-09-11 17:42:52 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","ls-files","--cached","-z","--","home.tar.gz"]
copy home.tar.gz (gpg) [2013-09-11 17:42:52 CEST] chat: gpg ["--quiet","--trust-model","always","--decrypt"]
(checking box.com...) (to box.com...)
[2013-09-11 17:42:57 CEST] chat: gpg ["--quiet","--trust-model","always","--batch","--passphrase-fd","11","--symmetric","--force-mdc","--no-textmode"]
35% 660.8KB/s 1h44mResponseTimeout
gpg: [stdout]: write error: Broken pipe
gpg: DBG: deflate: iobuf_write failed
gpg: build_packet failed: file write error
gpg: [stdout]: write error: Broken pipe
gpg: iobuf_flush failed on close: file write error
gpg: [stdout]: write error: Broken pipe
gpg: iobuf_flush failed on close: file write error
gpg: symmetric encryption of `[stdin]' failed: file write error
git-annex: fd:13: hPutBuf: resource vanished (Broken pipe)
failed
git-annex: copy: 1 failed
$ git annex copy --verbose --debug home.tar.gz --to box.com
[2013-09-11 19:38:26 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","show-ref","git-annex"]
[2013-09-11 19:38:26 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","show-ref","--hash","refs/heads/git-annex"]
[2013-09-11 19:38:26 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","log","refs/heads/git-annex..1e029f92c5c82b094cbe70b55927996c31579e2e","--oneline","-n1"]
[2013-09-11 19:38:26 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","log","refs/heads/git-annex..1090c21b121fd8b6e2ab49a772c8eab5235a3930","--oneline","-n1"]
[2013-09-11 19:38:26 CEST] chat: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","cat-file","--batch"]
[2013-09-11 19:38:26 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","ls-files","--cached","-z","--","home.tar.gz"]
copy home.tar.gz (gpg) [2013-09-11 19:38:26 CEST] chat: gpg ["--quiet","--trust-model","always","--decrypt"]
(checking box.com...) ok
$ git annex whereis --verbose --debug home.tar.gz
[2013-09-11 19:38:57 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","show-ref","git-annex"]
[2013-09-11 19:38:57 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","show-ref","--hash","refs/heads/git-annex"]
[2013-09-11 19:38:57 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","log","refs/heads/git-annex..1e029f92c5c82b094cbe70b55927996c31579e2e","--oneline","-n1"]
[2013-09-11 19:38:57 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","log","refs/heads/git-annex..1090c21b121fd8b6e2ab49a772c8eab5235a3930","--oneline","-n1"]
[2013-09-11 19:38:57 CEST] chat: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","cat-file","--batch"]
[2013-09-11 19:38:57 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","ls-files","--cached","-z","--","home.tar.gz"]
whereis home.tar.gz (2 copies)
d7db543e-5463-11e2-b7dd-9f423f798cc4 -- here (em@ocracy:/data/backup)
e71fa45e-5463-11e2-a14e-93ca09c272da -- box.com
ok
$ git annex fsck --verbose --debug home.tar.gz
[2013-09-11 19:39:05 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","ls-files","--cached","-z","--","home.tar.gz"]
[2013-09-11 19:39:05 CEST] chat: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","check-attr","-z","--stdin","annex.backend","annex.numcopies","--"]
fsck home.tar.gz [2013-09-11 19:39:05 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","show-ref","git-annex"]
[2013-09-11 19:39:05 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","show-ref","--hash","refs/heads/git-annex"]
[2013-09-11 19:39:05 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","log","refs/heads/git-annex..1e029f92c5c82b094cbe70b55927996c31579e2e","--oneline","-n1"]
[2013-09-11 19:39:05 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","log","refs/heads/git-annex..1090c21b121fd8b6e2ab49a772c8eab5235a3930","--oneline","-n1"]
[2013-09-11 19:39:05 CEST] chat: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","cat-file","--batch"]
(checksum...) [2013-09-11 19:39:05 CEST] read: sha256sum ["/data/backup/.git/annex/objects/mG/kp/SHA256E-s6640317400--dcf0a535728f3f3f787db6339b740a4a6f6529e5ce1d238f28574499a8172670.tar.gz/SHA256E-s6640317400--dcf0a535728f3f3f787db6339b740a4a6f6529e5ce1d238f28574499a8172670.tar.gz"]
ok
$ git annex fsck --verbose --debug home.tar.gz --from box.com
[2013-09-11 19:42:15 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","show-ref","git-annex"]
[2013-09-11 19:42:15 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","show-ref","--hash","refs/heads/git-annex"]
[2013-09-11 19:42:15 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","log","refs/heads/git-annex..1e029f92c5c82b094cbe70b55927996c31579e2e","--oneline","-n1"]
[2013-09-11 19:42:15 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","log","refs/heads/git-annex..1090c21b121fd8b6e2ab49a772c8eab5235a3930","--oneline","-n1"]
[2013-09-11 19:42:15 CEST] chat: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","cat-file","--batch"]
[2013-09-11 19:42:15 CEST] read: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","ls-files","--cached","-z","--","home.tar.gz"]
[2013-09-11 19:42:15 CEST] chat: git ["--git-dir=/data/backup/.git","--work-tree=/data/backup","check-attr","-z","--stdin","annex.backend","annex.numcopies","--"]
fsck home.tar.gz (gpg) [2013-09-11 19:42:15 CEST] chat: gpg ["--quiet","--trust-model","always","--decrypt"]
(checking box.com...)
[2013-09-11 19:42:28 CEST] chat: gpg ["--quiet","--trust-model","always","--batch","--passphrase-fd","10","--decrypt"]
gpg: decrypt_message failed: eof
ok
</code></pre>