Adding existing S3 bucket to sync with

Hello,

I am just starting to learn git-annex so forgive me if this is a naive question.

I have the following repositories:

Home (laptop)
Work (mac mini)
S3 bucket
USB drive, full backup, attached to Home laptop.

I want to sync files between Home and Work via the S3 bucket. It is not clear to me how to accomplish this through the git-annex assistant. Is this possible? Are there instructions online?

Thanks in advance!

Scott

RSS Atom

Yes, it is possible

You can sync both repos. The simplest way is to have both clients signed on to jabber. This way the clients exchange information when the two are online.

Additionally you need to have a cloud special remote available on both ends. The cloud repository is needed to push and retrieve data for the clients. You need to configure the cloud as a transfer reposity. The clients as - what else - client. The USB Drive can be used as a backup repository on one or both ends and perhaps even for syncing very large files around.

Comment by marco [paga.myopenid.com] — Mon Aug 19 17:59:56 2013

Remove comment

I forgot to mention

You might want to have a look at this: https://git-annex.branchable.com/assistant/remote_sharing_walkthrough/

Comment by marco [paga.myopenid.com] — Mon Aug 19 18:01:47 2013

Remove comment

comment 3

Great thanks! I'll try it out tonight and report back.

Comment by Scott — Mon Aug 19 18:03:41 2013

Remove comment

comment 4

When I try to setup my Jabber client, using my gmail address, the assistant crashes. I thought this might be due to having two-factor authentication enabled so I generated an application specific password and tried that. The assistant still crashes. The log is huge, I am not sure what would be relevant to show here.

Comment by Scott — Tue Aug 20 16:18:24 2013

Remove comment

Please post the log

I don't know what is going wrong. It is not a bad idea to post the log information.

Comment by marco [paga.myopenid.com] — Wed Aug 21 15:49:00 2013

Remove comment

comment 6

I tried a different approach and attempted to setup s3 at the command line. This is what I did:

zombie:annex scott$ export AWS_ACCESS_KEY_ID="my key" zombie:annex scott$ export AWS_SECRET_ACCESS_KEY="my secret key" zombie:annex scott$ git annex initremote S3 type=S3 encryption=shared [2013-08-21 13:03:42 PDT] read: git ["--git-dir=/Network/Servers/filer004/vol/office_homes/scott/annex/.git","--work-tree=/Network/Servers/filer004/vol/office_homes/scott/annex","show-ref","git-annex"] [2013-08-21 13:03:42 PDT] read: git ["--git-dir=/Network/Servers/filer004/vol/office_homes/scott/annex/.git","--work-tree=/Network/Servers/filer004/vol/office_homes/scott/annex","show-ref","--hash","refs/heads/git-annex"] [2013-08-21 13:03:42 PDT] read: git ["--git-dir=/Network/Servers/filer004/vol/office_homes/scott/annex/.git","--work-tree=/Network/Servers/filer004/vol/office_homes/scott/annex","log","refs/heads/git-annex..da801570f9ed8d28e5a0cea6cc51f1a2003317d6","--oneline","-n1"] [2013-08-21 13:03:42 PDT] read: git ["--git-dir=/Network/Servers/filer004/vol/office_homes/scott/annex/.git","--work-tree=/Network/Servers/filer004/vol/office_homes/scott/annex","log","refs/heads/git-annex..8015f3fed32792b558d16008d20816fab0fc50c2","--oneline","-n1"] [2013-08-21 13:03:42 PDT] chat: git ["--git-dir=/Network/Servers/filer004/vol/office_homes/scott/annex/.git","--work-tree=/Network/Servers/filer004/vol/office_homes/scott/annex","cat-file","--batch"] [2013-08-21 13:03:42 PDT] read: git ["config","--null","--list"] initremote S3 (encryption setup) [2013-08-21 13:03:42 PDT] read: gpg ["--quiet","--trust-model","always","--gen-random","--armor","2","512"] (shared cipher) (checking bucket...) git-annex: connect: does not exist (Connection refused) failed git-annex: initremote: 1 failed

Comment by Scott — Wed Aug 21 20:05:31 2013

Remove comment

comment 7

Sorry that didnt format properly

zombie:annex scott$ export AWS_ACCESS_KEY_ID="key"
zombie:annex scott$ export AWS_SECRET_ACCESS_KEY="secret"
zombie:annex scott$ git annex initremote S3 type=S3 encryption=shared
[2013-08-21 13:03:42 PDT] read: git ["--git-dir=/Network/Servers/filer004/vol/office_homes/scott/annex/.git","--work-tree=/Network/Servers/filer004/vol/office_homes/scott/annex","show-ref","git-annex"]
[2013-08-21 13:03:42 PDT] read: git ["--git-dir=/Network/Servers/filer004/vol/office_homes/scott/annex/.git","--work-tree=/Network/Servers/filer004/vol/office_homes/scott/annex","show-ref","--hash","refs/heads/git-annex"]
[2013-08-21 13:03:42 PDT] read: git ["--git-dir=/Network/Servers/filer004/vol/office_homes/scott/annex/.git","--work-tree=/Network/Servers/filer004/vol/office_homes/scott/annex","log","refs/heads/git-annex..da801570f9ed8d28e5a0cea6cc51f1a2003317d6","--oneline","-n1"]  
[2013-08-21 13:03:42 PDT] read: git ["--git-dir=/Network/Servers/filer004/vol/office_homes/scott/annex/.git","--work-tree=/Network/Servers/filer004/vol/office_homes/scott/annex","log","refs/heads/git-annex..8015f3fed32792b558d16008d20816fab0fc50c2","--oneline","-n1"  ]
[2013-08-21 13:03:42 PDT] chat: git ["--git-dir=/Network/Servers/filer004/vol/office_homes/scott/annex/.git","--work-tree=/Network/Servers/filer004/vol/office_homes/scott/annex","cat-file","--batch"]
[2013-08-21 13:03:42 PDT] read: git ["config","--null","--list"]
initremote S3 (encryption setup) [2013-08-21 13:03:42 PDT] read: gpg ["--quiet","--trust-model","always","--gen-random","--armor","2","512"]
(shared cipher) (checking bucket...)
git-annex: connect: does not exist (Connection refused)
failed
git-annex: initremote: 1 failed

Comment by Scott — Wed Aug 21 20:07:58 2013

Remove comment

Add a comment