forum/Annex slow on Windows/direct modegit-annexhttp://git-annex.branchable.com/forum/Annex_slow_on_Windows__47__direct_mode/git-annexikiwiki2014-07-07T10:23:23ZSame boathttp://git-annex.branchable.com/forum/Annex_slow_on_Windows__47__direct_mode/comment_1_d80839f4582fc2a6269db31e30e1dbab/Phil2014-07-03T19:38:15Z2014-07-03T19:38:15Z
I'd love to know this too. I'm setting up on 2 Windows 8.1 machines (with a 3rd Windows 7 hopefully joining the party as well as a couple of Linux boxes) but doing anything is really slow. I just ran git annex status on a 50GB, 7000 file Music repo and it took 6 minutes. I've not even setup the remotes yet but as soon as I'd added and sync'd, things slowed down. I'm running on a nippy SSD and CPU usage is around 12%.
comment 2http://git-annex.branchable.com/forum/Annex_slow_on_Windows__47__direct_mode/comment_2_593e1e01b70a2b6a15ad6bca09a80c7b/Phil2014-07-03T19:39:12Z2014-07-03T19:39:12Z
Fortunately, git annex sync is pretty quick
comment 3http://git-annex.branchable.com/forum/Annex_slow_on_Windows__47__direct_mode/comment_3_c4e4c596f31aa97645fe1e1527dc2c31/joeyh.name2014-07-04T20:57:54Z2014-07-04T20:57:54Z
<p>Yall need to tell me your git-annex versions. <a href="http://git-annex.branchable.com/devblog/day_183__rubbing_sticks_together/">day 183 rubbing sticks together</a> fixed a horrible slowdown that indeed causes git-annex on windows to unnecessarily look at lots of files.</p>
<p>Also, is this using the git-annex assistant, or using git-annex at the command line that's being slow?</p>
<p>As to using symlinks on windows, cygwin's build of git is able to handle them somehow. I have not tried to get it working with git-annex, but it seems at least possible that indirect mode could be accomplished that way.</p>
Also in the same boathttp://git-annex.branchable.com/forum/Annex_slow_on_Windows__47__direct_mode/comment_4_92db0b99ada9af15a5383da41397ebd7/divB2014-07-07T01:12:18Z2014-07-07T01:12:18Z
<p>Even worse here. git-annex looked (and still looks) so promising for exactly I want (share >100GB photos/data with my girlfriend which are on my private DSL connected server but each of us should only download whatever he currently needs for offline usage and everything should stay consistent, e.g. is one edits, adds or deletes files). However, after long testing in Windows I gave up. I had so many issues and speed was one of them. So I looked again at other solutions (ownCloud pydio) but they are not good either. unison is one thing that just works perfectly but it is not suited to sync huge stuff where just parts are available on one machine.</p>
<p>I still put much hope in git-annex that it's useable at some point also in Windows. If there would be another of these kickstarters for that, I'd be in.</p>
<p>One BIG dealbreaker for me is SSH. It popped up a couple of times already there is inconsistency between ssh.exe, plink.exe and %GIT_SSH%.
But the biggest issue is that ssh.exe in Windows does not do connection sharing: For each single file a new SSH session is created! That way it works only for huge files (movies) where the overhead is small. In my tests I had smaller files, that's just unuseable.</p>
<p>I know it's a conundrum. unison just leaves one ssh connection open, that would be nice. I know however that this requires bigger changes. But what about for example starting something in background (during a git-annex command) that leaves the SSH session open and pumps data via some IPC?</p>
<p>Last but not least: links. I agree windows links are unuseable. But would it really be real links? What about just basic *.lnk files?</p>
comment 5http://git-annex.branchable.com/forum/Annex_slow_on_Windows__47__direct_mode/comment_5_3d628c9db9ebdfd5bff92af105c47719/divB2014-07-07T01:16:21Z2014-07-07T01:16:21Z
<p>One more thing: integration in TortoiseGit would be sooooooooo great! You would then even be able to let novice computer users use git-annex.</p>
<p>I added a feature request long time ago but it's on hold: http://code.google.com/p/tortoisegit/issues/detail?id=2166</p>
<p>I do hope that git-annex becomes more popular to increase the chance that it will be built into that...</p>
Connection sharing workaroundhttp://git-annex.branchable.com/forum/Annex_slow_on_Windows__47__direct_mode/comment_6_db7965fa928c093233769ed52b2fcd43/Idhup2014-07-07T10:20:23Z2014-07-07T10:20:23Z
<p>I had the same issues but was able to work around most of them. I simply created keypairs on my Windows machines that allowed me to log in to my Ubuntu server. Means that while the overhead does make it smaller (I guess), the whole sync process can simply be run in the background without me having to check for a password prompt for 30 minutes, just to miss the short period during which I can enter it. Also, the actual object storage was moved to a directory special remote on the server, so Windows clients can simply automount a samba share and push the content over that line, which is less of a hazzle.</p>
<p>Also, the speed issue got <em>much</em> better when I added all files. I still had a lot of files just lying around on my Windows machine. Once I added them all, the sync process sped up by several magnitudes. So, if https://git-annex.branchable.com/forum/fatal:<em>Out_of_memory<strong>63</strong></em>mmap_failed:_No_such_file_or_directory/ can be solved, I guess I'm happy on Windows.</p>
typohttp://git-annex.branchable.com/forum/Annex_slow_on_Windows__47__direct_mode/comment_7_674f52c5e5484207db403b18efc986c6/Idhup2014-07-07T10:23:23Z2014-07-07T10:23:23Z
Slower. It's not smaller, it's slower. Gee.