Possible bug in setting up Rsync.net remote

Here is a line from the debug log...

[2016-09-08 13:08:37.01053] chat: ssh
  ["-oNumberOfPasswordPrompts=0","-oStrictHostKeyChecking=no",
   "9553@git-annex-.usw.2Ds009.2Ersync.2Enet-9553_22_annex",
   "mkdir -p .ssh;touch .ssh/authorized_keys;dd of=.ssh/authorized_keys oflag=append conv=notrunc;mkdir -p annex"]

The hostname I entered was ordinary: usw-s009.rsync.net... but as you can see, the user@host:port string is mangled.

I'm using git tag 6.20160907 with changes to git-annex.cabal and stack.yaml to force use of concurrent-output-1.7.7 since 1.7.6 had a bug that kept it from building on Windows (I guess?).

Oh, this is on Windows, in case that wasn't clear...

I think the bug is in ${git-annex-root}/Assistant/Ssh.hs or ${git-annex-root}/Assistant/Pairing/MakeRemote.hs. The .2D and .2E bits in the mangled string make me think that the - and . characters in my hostname are being replaced by some Haskell representation of those values (2D in hexadecimal in ASCII is -, 2E is .).

But I've never even written hello world in Haskell so my path ends there.

I'm happy to pull some tag or branch from github and run stack install over again and try adding the rsync.net remote again.

I hope this helps!

Cheers,

--Dave

RSS Atom

output of git annex version

$ git annex version
git-annex version: 6.20160907-gad0a7f6
build flags: Assistant Webapp Pairing Testsuite S3(multipartupload)(storageclasses) WebDAV ConcurrentOutput TorrentParser Feeds Quvi
key/value backends: SHA256E SHA256 SHA512E SHA512 SHA224E SHA224 SHA384E SHA384 SHA3_256E SHA3_256 SHA3_512E SHA3_512 SHA3_224E
                    SHA3_224 SHA3_384E SHA3_384 SKEIN256E SKEIN256 SKEIN512E SKEIN512 SHA1E SHA1 MD5E MD5 WORM URL
remote types: git gcrypt S3 bup directory rsync web bittorrent webdav tahoe glacier ddar hook external
local repository version: unknown
supported repository versions: 5 6
upgrade supported from repository versions: 2 3 4 5
operating system: mingw32 x86_64

Comment by dave — Thu Sep 8 18:48:43 2016

Remove comment

Similar issue on Debian machine

OK, let's try this on a GNU machine (debian, sid) running a git-annex from the official debian repos:

$ git annex version
git-annex version: 6.20160808
build flags: Assistant Webapp Pairing Testsuite S3(multipartupload)(storageclasses) WebDAV Inotify DBus DesktopNotify
             XMPP ConcurrentOutput TorrentParser MagicMime Feeds Quvi
key/value backends: SHA256E SHA256 SHA512E SHA512 SHA224E SHA224 SHA384E SHA384 SHA3_256E SHA3_256 SHA3_512E SHA3_512
                    SHA3_224E SHA3_224 SHA3_384E SHA3_384 SKEIN256E SKEIN256 SKEIN512E SKEIN512 SHA1E SHA1 MD5E MD5 WORM URL
remote types: git gcrypt S3 bup directory rsync web bittorrent webdav tahoe glacier ddar hook external
local repository version: 5
supported repository versions: 5 6
upgrade supported from repository versions: 0 1 2 3 4 5
operating system: linux x86_64

Now, this time, the error message in the web app says something ordinary: Permission denied (publickey,password,keyboard-interactive).. However, I see this in the log:

[2016-09-08 14:56:36.125939] read: ssh-keygen ["-F","usw-s009.rsync.net"]
[2016-09-08 14:56:36.134026] process done ExitSuccess
[2016-09-08 14:56:36.1344] chat: ssh [
    "-oNumberOfPasswordPrompts=0",
    "9553@git-annex-.usw.2Ds009.2Ersync.2Enet-9553_22_annex",
    "mkdir -p .ssh;touch .ssh/authorized_keys;dd of=.ssh/authorized_keys oflag=append conv=notrunc;mkdir -p annex"
]
[2016-09-08 14:56:36.71948] process done ExitFailure 255

As you can see, that string mangling is present there too.

Comment by dave — Thu Sep 8 20:04:45 2016

Remove comment

comment 3

That mangling of the hostname is completely normal.

Your problem description lacked a description of an actual problem. Is something not working, or were you put off by this ugly looking hostname? If something is not working, what is the error message?

Comment by joey — Wed Sep 21 17:08:41 2016

Remove comment

comment 4

The error message "Permission denied (publickey,password,keyboard-interactive)" seems to be saying you entered the wrong password for rsync.net.

Comment by joey — Wed Sep 21 17:18:35 2016

Remove comment

re: mangling is normal

... ok, here's the original message from the (web) UI:

ssh: Could not resolve hostname git-annex-.usw.2ds009.2ersync.2enet-9553_22_annex: Name or service not known

I had figured the debug log might be helpful... Pardon me...

Comment by dave — Wed Sep 21 21:12:16 2016

Remove comment

re: regular ssh remote

I tried adding my rsync.net space as a regular (ssh) remote instead of as an rsync.net remote. I got this in the webapp:

Failed to ssh to the server. Transcript:

(sic)

This time the debug log shows this:

[2016-09-21 16:19:15.0106417] read: ssh-keygen ["-F","usw-s009.rsync.net"]
[2016-09-21 16:19:15.2376417] process done ExitSuccess
[2016-09-21 16:19:15.2376417] chat: ssh [
  "-oNumberOfPasswordPrompts=0",
  "-oStrictHostKeyChecking=yes",
  "-n",
  "-p",
  "22",
  "9553@usw-s009.rsync.net",
  "sh -c 'echo '\"'\"'git-annex-probe loggedin'\"'\"';if which git-annex-shell; then echo '\"'\"'git-annex-probe git-annex-shell'\"'\"'; fi;if which git; then echo '\"'\"'git-annex-probe git'\"'\"'; fi;if which rsync; then echo '\"'\"'git-annex-probe rsync'\"'\"'; fi;if which ~/.ssh/git-annex-shell; then echo '\"'\"'git-annex-probe ~/.ssh/git-annex-shell'\"'\"'; fi;if which ~/.ssh/git-annex-wrapper; then echo '\"'\"'git-annex-probe ~/.ssh/git-annex-wrapper'\"'\"'; fi;cd '\"'\"'annex'\"'\"' && git config --list'"]
[2016-09-21 16:19:17.4001417] process done ExitFailure 1

For what it is worth:

$ ssh -oNumberOfPasswordPrompts=0 -oStrictHostKeyChecking=yes -n -p 22 9553@usw-s009.rsync.net sh -c 'echo hello'

THAT fails with exit code 1. But that's just because it's rsync.net, a restricted shell... (The same command with just 'ls' works!)

I'm back to thinking that it's actually trying to resolve the mangled string. However, I've been known to be completely wrong before!

Comment by dave — Wed Sep 21 21:30:24 2016

Remove comment

Add a comment