This is where announcements of new releases, features, and other news is posted. git-annex users are recommended to subscribe to this page's RSS feed. Also, see security for security announcements.

RSS Atom Add a new post titled:

git-annex 8.20211123 released with these changes

  • Bugfix: When -J was enabled, getting files could leak an ever-growing number of git cat-file processes.
  • Support git's new "ort" resolver, which became the default in git 2.34.0, and broke the test suite and automatic merge resolution of a conflict between an annexed file and a non-annexed file.
  • importfeed: Display url before starting youtube-dl download.
Posted Tue Nov 23 19:21:08 2021

git-annex 8.20211117 released with these changes

  • filter-process: New command that can make git add/checkout faster when there are a lot of unlocked annexed files or non-annexed files, but that also makes git add of large annexed files slower. Use it by running: git config filter.annex.process 'git-annex filter-process'
  • Fix a typo in the name of youtube-dl (reversion introduced in version 8.20210903)
  • git-lfs: Fix interoperability with gitlab's implementation of the git-lfs protocol, which requests Content-Encoding chunked.
  • importfeed: Fix a crash when used in a non-unicode locale.
  • migrate: New --remove-size option.
  • uninit: Avoid error message when no commits have been made to the repository yet.
  • uninit: Avoid error message when there is no git-annex branch.
  • metadata --batch: Avoid crashing when a non-annexed file is input, instead output a blank line like other batch commands do.
  • metadata --batch --json: Reject input whose "fields" does not consist of arrays of strings. Such invalid input used to be silently ignored.
Posted Wed Nov 17 16:21:18 2021

git-annex 8.20211028 released with these changes

  • Removed support for accessing git remotes that use versions of git-annex older than 6.20180312.
  • git-annex-shell: Removed several commands that were only needed to support git-annex versions older than 6.20180312.
  • Negotiate P2P protocol version with tor remotes, allowing use of protocol version 1. This negotiation is not supported by versions of git-annex older than 6.20180312.
  • Fix bug that caused stale git-annex branch information to read when annex.private or remote.name.annex-private is set.
  • git-annex get when run as the first git-annex command in a new repo did not populate all unlocked files. (Reversion in version 8.20210621)
  • Fix using lookupkey and info inside a subdirectory of the git repository. (Reversion in version 8.20211011)
  • Avoid some sqlite crashes on Windows SubSystem for Linux (WSL).
  • Call annex.freezecontent-command on the annex object file after it has been moved into place in annex/objects/. This allows the hook to freeze the file in ways that prevent moving it, such as removing the Windows delete permission. Thanks, Reiko Asakura.
  • addurl: Support adding the same url to multiple files at the same time when using -J with --batch --with-files.
  • When retrieval from a chunked remote fails, display the error that occurred when downloading the chunk, rather than the error that occurred when trying to download the unchunked content, which is less likely to actually be stored in the remote.
  • Avoid crashing tilde expansion on user who does not exist.
  • test: Put gpg temp home directory in system temp directory, not filesystem being tested.
Posted Thu Oct 28 16:01:41 2021

git-annex 8.20211011 released with these changes

  • Added annex.bwlimit and remote.name.annex-bwlimit config to limit the bandwidth of transfers. It works for git remotes and many but not all special remotes.
  • Bug fix: Git configs such as annex.verify were incorrectly overriding per-remote git configs such as remote.name.annex-verify. (Reversion in version 4.20130323)
  • borg: Significantly improved memory use when a borg repository contains many archives.
  • borg: Avoid trying to extract xattrs, ACLS, and bsdflags when retrieving from a borg repository.
  • Sped up git-annex smudge --clean by 25%.
  • Resume where it left off when copying a file to/from a local git remote was interrupted.
  • sync --content: Avoid a redundant checksum of a file that was incrementally verified, when used on NTFS and perhaps other filesystems.
  • reinject: Fix crash when reinjecting a file from outside the repository. (Reversion in version 8.20210621)
  • Avoid cursor jitter when updating progress display.
Posted Mon Oct 11 16:53:48 2021

git-annex 8.20210903 released with these changes

  • Deal with clock skew, both forwards and backwards, when logging information to the git-annex branch.
  • GIT_ANNEX_VECTOR_CLOCK can now be set to a fixed value (eg 1) rather than needing to be advanced each time a new change is made.
  • Misuse of GIT_ANNEX_VECTOR_CLOCK will no longer confuse git-annex.
  • add: When adding a dotfile, avoid treating its name as an extension.
  • rsync special remote: Stop displaying rsync progress, and use git-annex's own progress display.
  • Many special remotes now checksum content while it is being retrieved, instead of in a separate pass at the end. This is supported for all special remotes on Linux (except for bittorrent), and for many on other OS's (except for adb, external, gcrypt, hook, and rsync).
  • unused: Skip the refs/annex/last-index ref that git-annex recently started creating.
  • Fix test suite failure on Windows.
  • New --batch-keys option added to these commands: get, drop, move, copy, whereis
  • Added annex.youtube-dl-command config. This can be used to run some forks of youtube-dl.
  • Run cp -a with --no-preserve=xattr, to avoid problems with copied xattrs, including them breaking permissions setting on some NFS servers.
  • add, import: Detect when xattrs or perhaps ACLs prevent removing write permissions from an annexed file, and fail with an informative message.
  • Fix support for readonly git remotes. (Reversion in version 8.20210621)
  • When downloading urls fail, explain which urls failed for which reasons.
  • web: Avoid displaying a warning when downloading one url failed but another url later succeeded.
Posted Fri Sep 3 16:01:44 2021

Similar to the yearly git user survey, there is a 2018 git-annex user survey.

If you use git-annex, please take a few minutes to answer the questions!

Since git-annex is seeing increasing use to manage scientific data, the survey also includes some extra questions about that at the end.

Posted Sat Dec 1 15:46:38 2018

git-annex 6.20180626 is an important security fix release.

See the advisory for details about the security holes fixed in this release.

After upgrading git-annex, you should restart any git-annex assistant processes.

Several changes to git-annex's behavior had to be made as part of the security fixes:

  • A security fix has changed git-annex to refuse to download content from some special remotes when the content cannot be verified with a hash check. In particular URL and WORM keys stored on such remotes won't be downloaded. See the documentation of the annex.security.allow-unverified-downloads configuration for how to deal with this if it affects your files.

  • A security fix has changed git-annex to only support http, https, and ftp URL schemes by default. You can enable other URL schemes, at your own risk, using annex.security.allowed-url-schemes.

  • A related security fix prevents git-annex from connecting to http servers (and proxies) on localhost or private networks. This can be overridden, at your own risk, using annex.security.allowed-ip-addresses.

  • Setting annex.web-options no longer is enough to make curl be used, and youtube-dl is also no longer used by default. See the documentation of annex.security.allowed-http-addresses for details and how to enable them.

  • The annex.web-download-command configuration has been removed, use annex.web-options instead.

Posted Tue Jun 26 16:00:19 2018

Similar to the yearly git user survey, there is a 2015 git-annex user survey.

If you use git-annex, please take a few minutes to answer the questions!

Posted Mon Oct 19 20:05:12 2015

Similar to the yearly git user survey, I am doing a 2013 git-annex user survey.

If you use git-annex, please take a few minutes to answer my questions!

Posted Fri Nov 22 17:17:21 2013

Thanks to my recent successful git-annex crowdfunding campaign, $1000 has been set aside to award others for their contributions to git-annex by the end of 2013. This is not a lot of money, but I hope that the reward and recognition will encourage some more people to work on git-annex.

You don't need to know Haskell! You could contribute some interesting and useful special remote hooks, or write better documentation.

On the other hand, if you have learned Haskell, this might be your first chance to make some money with it! Some ideas for things to work on that would be particularly award-worthy:

  • Port git-annex to IOS, using ghc-ios. I don't plan to ever do this myself, but you could make it happen.
  • Get the git-annex assistant working in Windows, building on the existing port to Windows. Otherwise, this is on my roadmap for February.
  • Solve existing bugs or todo items. There are more than I can keep up with.

The amount of the awards will vary depending on the size of the contribution. Since this is getting started later than is ideal, I reserve the right to extend it past the end of the year if I don't get enough participants.

If you'd like to participate in this program, just email me at id@joeyh.name. --Joey

Posted Thu Oct 10 22:02:33 2013

git-annex will be briefly presented at FOSDEM, on Sunday February 4th at 15:40. Details.

Thanks to Richard Hartmann for making this presentation.

Posted Sat Feb 4 18:30:28 2012

Christophe-Marie Duquesne has just announced Sharebox, a FUSE filesystem relying on git-annex:

What are your goals?  
Seamless synchronization "à la dropbox".  
Ability to use with big binary files such as mp3/movies.  
Entirely decentralized.  
Don't use unnecessary space  
Keep it simple: avoid special VCS commands and keep a filesystem  
interface as much as possible.

While still alpha, this is promising. --Joey

Posted Thu Mar 31 18:06:14 2011

Linux Weekly News has a nice article on git-annex in it this week.

Posted Thu Dec 9 15:35:07 2010