This is where announcements of new releases, features, and other news is posted. git-annex users are recommended to subscribe to this page's RSS feed.

RSS Atom Add a new post titled:

git-annex 6.20180409 released with these changes

  • Added adb special remote which allows exporting files to Android devices.
  • For url downloads, git-annex now defaults to using a http library, rather than wget or curl. But, if annex.web-options is set, it will use curl. To use the .netrc file, run: git config annex.web-options --netrc
  • git-annex no longer uses wget (and wget is no longer shipped with git-annex builds).
  • Enable HTTP connection reuse across multiple files for improved speed.
  • Fix calculation of estimated completion for progress meter.
  • OSX app: Work around libz/libPng/ImageIO.framework version skew by not bundling libz, assuming OSX includes a suitable libz.1.dylib.
  • Added annex.retry, annex.retry-delay, and per-remote versions to configure transfer retries.
  • Also do forward retrying in cases where no exception is thrown, but the transfer failed.
  • When adding a new version of a file, and annex.genmetadata is enabled, don't copy the data metadata from the old version of the file, instead use the mtime of the file.
  • Avoid running annex.http-headers-command more than once.
  • info: Added "combined size of repositories containing these files" stat when run on a directory.
  • info: Changed sorting of numcopies stats table, so it's ordered by the variance from the desired number of copies.
  • Fix resuming a download when using curl.
Posted Mon Apr 9 17:24:54 2018

git-annex 6.20180316 released with these changes

  • New protocol for communicating with git-annex-shell increases speed of operations involving ssh remotes. When not transferring large files, git-annex is between 200% and 400% faster using the new protocol, and it's just as fast as before when transferring large files. (When the remote has an old git-annex-shell, git-annex falls back to the old slower code. This fallback is planned to be removed after 5 years or so.)
  • Note that, due to not using rsync to transfer files over ssh any longer, permissions and other file metadata of annexed files will no longer be preserved when copying them to and from ssh remotes. Other remotes never supported preserving that information, so this is not considered a regression.
  • Fix data loss bug in content locking over tor, when the remote repository is in direct mode, it neglected to check that the content was actually present when locking it. This could cause git annex drop to remove the only copy of a file when it thought the tor remote had a copy.
  • Fix data loss bug when the local repository uses direct mode, and a locally modified file is dropped from a remote repsitory. The bug caused the modified file to be counted as a copy of the original file. (This is not a severe bug because in such a situation, dropping from the remote and then modifying the file is allowed and has the same end result.)
  • Some downloads will be verified, even when annex.verify=false. This is done in some edge cases where there's a likelyhood than an object was downloaded incorrectly.
  • Support exporttree=yes for rsync special remotes.
  • Added backends for the BLAKE2 family of hashes, when built with a new enough version of cryptonite.
  • Improve SHA*E extension extraction code to not treat parts of the filename that contain punctuation or other non-alphanumeric characters as extensions. Before, such characters were filtered out.
  • Better ssh connection warmup when using -J for concurrency. Avoids ugly messages when forced ssh command is not git-annex-shell.
  • Fix race condition in ssh warmup that caused git-annex to get stuck and never process some files when run with high levels of concurrency.
  • Fix reversion introduced in 6.20171214 that caused concurrent transfers to incorrectly fail with "transfer already in progress".
  • Note that Remote/Git.hs now contains AGPL licensed code, thus the license of git-annex as a whole is AGPL. This was already the case when git-annex was built with the webapp enabled.
  • Include amount of data transferred in progress display.
  • Dial back optimisation when building on arm, which prevents ghc and llc from running out of memory when optimising some files.
Posted Fri Mar 16 16:40:39 2018

git-annex 6.20180227 released with these changes

  • inprogress: Avoid showing failures for files not in progress.
  • Added INFO to external special remote protocol.
  • Added EXTENSIONS to external special remote protocol.
  • datalad < 0.9.1 had a problem in its special remote protocol handling which is broken by EXTENSIONS. Make the debian git-annex package conflict with the problem version of datalad.
  • fsck: Warn when required content is not present in the repository that requires it.
  • Add gpg-agent to Build-Depends. Needed to run the test suite.
  • --json: When there are multiple lines of notes about a file, make the note field multiline, rather than the old behavior of only including the last line.
  • git-annex.cabal: Once more try to not build the assistant on the hurd, hopefully hackage finally recognises that OS.
  • Split Test.hs and avoid optimising it much, to need less memory to compile.
  • Fix behavior of --json-progress followed by --json, the latter option used to disable the former.
  • Added --json-error-messages option, which makes messages that would normally be output to standard error be included in the json output.
  • Remove temporary code added in 6.20160619 to prime the mergedrefs log.
  • importfeed: Fix a failure when downloading with youtube-dl and the destination subdirectory does not exist yet.
  • Added annex.merge-annex-branches config setting which can be used to disable automatic merge of git-annex branches.
  • tips/automatically_adding_metadata/pre-commit-annex: Fix to not silently skip filenames containing non-ascii characters.
  • sync: Fix bug that prevented pulling changes into direct mode repositories that were committed to remotes using git commit rather than git-annex sync.
  • Makefile: Remove chrpath workaround for bug in cabal, which is no longer needed.
Posted Tue Feb 27 16:05:57 2018

git-annex 6.20180112 released with these changes

  • Added inprogress command for accessing files as they are being downloaded.
  • Fix bug introduced in version 6.20171018 that caused some commands to print out "ok" twice after processing a file.
  • addurl: When the file youtube-dl will download is already an annexed file, don't download it again and fail to overwrite it, instead just do nothing, like it used to when quvi was used.
  • addurl: Fix encoding of filename queried from youtube-dl when in --fast mode.
  • Fix several places where files in .git/annex/ were written with modes that did not take the core.sharedRepository config into account.
  • Improve startup time for commands that do not operate on remotes, and for tab completion, by not unnessessarily statting paths to remotes, which used to cause eg, spin-up of removable drives.
  • Added remote.<name>.annex-checkuuid config, which can be set to false to disable the default checking of the uuid of remotes that point to directories. This can be useful to avoid unncessary drive spin-ups and automounting.
  • git-annex.cabal: Add back custom-setup stanza, so cabal new-build works.
  • git-annex.cabal: Removed the testsuite build flag; test suite is always included.
Posted Fri Jan 12 19:48:07 2018

Similar to the yearly git user survey, there is a 2015 git-annex user survey.

If you use git-annex, please take a few minutes to answer the questions!

Posted Mon Oct 19 20:05:12 2015

Similar to the yearly git user survey, I am doing a 2013 git-annex user survey.

If you use git-annex, please take a few minutes to answer my questions!

Posted Fri Nov 22 17:17:21 2013

Thanks to my recent successful git-annex crowdfunding campaign, $1000 has been set aside to award others for their contributions to git-annex by the end of 2013. This is not a lot of money, but I hope that the reward and recognition will encourage some more people to work on git-annex.

You don't need to know Haskell! You could contribute some interesting and useful special remote hooks, or write better documentation.

On the other hand, if you have learned Haskell, this might be your first chance to make some money with it! Some ideas for things to work on that would be particularly award-worthy:

  • Port git-annex to IOS, using ghc-ios. I don't plan to ever do this myself, but you could make it happen.
  • Get the git-annex assistant working in Windows, building on the existing port to Windows. Otherwise, this is on my roadmap for February.
  • Solve existing bugs or todo items. There are more than I can keep up with.

The amount of the awards will vary depending on the size of the contribution. Since this is getting started later than is ideal, I reserve the right to extend it past the end of the year if I don't get enough participants.

If you'd like to participate in this program, just email me at --Joey

Posted Thu Oct 10 22:02:33 2013

git-annex will be briefly presented at FOSDEM, on Sunday February 4th at 15:40. Details.

Thanks to Richard Hartmann for making this presentation.

Posted Sat Feb 4 18:30:28 2012

Christophe-Marie Duquesne has just announced Sharebox, a FUSE filesystem relying on git-annex:

What are your goals?  
Seamless synchronization "à la dropbox".  
Ability to use with big binary files such as mp3/movies.  
Entirely decentralized.  
Don't use unnecessary space  
Keep it simple: avoid special VCS commands and keep a filesystem  
interface as much as possible.

While still alpha, this is promising. --Joey

Posted Thu Mar 31 18:06:14 2011

Linux Weekly News has a nice article on git-annex in it this week.

Posted Thu Dec 9 15:35:07 2010