This is where announcements of new releases, features, and other news is posted. git-annex users are recommended to subscribe to this page's RSS feed. Also, see security for security announcements.

RSS Atom Add a new post titled:

git-annex 8.20210223 released with these changes

  • annex.stalldetection can now be set to "true" to make git-annex do automatic stall detection when it detects a remote is updating its transfer progress consistently enough for stall detection to work.
  • When annex.stalldetection is not enabled and a likely stall is detected, display a suggestion to enable it.
  • Commands can be added to git-annex, by installing a program in PATH with a name starting with "git-annex-"
  • Fix a reversion that made import of a tree from a special remote result in a merge that deleted files that were not preferred content of that special remote.
  • Bugfix: fsck --from a ssh remote did not actually check that the content on the remote is not corrupted.
  • unannex, uninit: When an annexed file is modified, don't overwrite the modified version with an older version from the annex.
  • When adding files to an adjusted branch set up by --unlock-present, add them unlocked, not locked.
  • Fix an oddity in matching options and preferred content expressions such as "foo (bar or baz)", which was incorrectly handled as if it were "(foo or bar) and baz)" rather than the intended "foo and (bar or baz)"
  • Checksum as content is received from a remote git-annex repository, rather than doing it in a second pass.
  • Tahoe: Avoid verifying hash after download, since tahoe does sufficient verification itself.
  • unannex, uninit: Don't run git rm once per annexed file, for a large speedup.
  • When a git remote is configured with an absolute path, use that path, rather than making it relative.
  • get: Improve output when failing to get a file fails.
  • Fix build on openbsd. Thanks, James Cook for the patch.
  • Include libkqueue.h file needed to build the assistant on BSDs.
Posted Tue Feb 23 18:41:56 2021

git-annex 8.20210127 released with these changes

  • Added mincopies configuration. This is like numcopies, but is enforced even more strictly. While numcopies can be violated in concurrent drop situations involving special remotes that do not support locking, mincopies cannot be. The default value has always been 1, but now it can be set to higher values if desired.
  • Behavior change: When numcopies is set to 0, git-annex used to drop content without requiring any copies. Now to get that (highly unsafe) behavior, mincopies also needs to be set to 0.
  • Behavior change: git-annex trust now needs --force, since unconsidered use of trusted repositories can lead to data loss.
  • Behavior change: --trust and --trust-glacier options no longer overrides trust, since that can lead to data loss, which should never be enabled by an option other than --force.
  • add: Significantly speed up adding lots of non-large files to git, by disabling the annex smudge filter when running git add.
  • add --force-small: Run git add rather than updating the index itself, so any other smudge filters than the annex one that may be enabled will be used.
  • Fix --time-limit, which got broken in several ways by some optimisations in version 8.20201007.
  • When syncing changes back from an adjusted branch to the basis branch, include deletions of submodules. Thanks, Kyle Meyer for the patch.
  • Bug fix: export with -J could fail when two files had the same content.
  • Bug fix: Fix tilde expansion in ssh urls when the tilde is the last character in the url. Thanks, Grond for the patch.
  • Avoid crashing when there are remotes using unparseable urls. Including the non-standard URI form that git-remote-gcrypt uses for rsync.
  • Directory special remotes with importtree=yes now avoid unncessary hashing when inodes of files have changed, as happens whenever a FAT filesystem gets remounted.
  • Fix a bug that prevented git-annex init from working in a submodule.
  • Fix a bug in view filename generation when a metadata value ended with "/" (or ":" or "\" on Windows)
  • adjust: Fix some bad behavior when unlocked files use URL keys.
  • smudge: Fix some bad behavior when git add is run on an unlocked file that used an URL key.
  • Added GETGITREMOTENAME to external special remote protocol.
  • Windows: Work around win32 length limits when dealing with lock files.
Posted Wed Jan 27 15:14:23 2021

git-annex 8.20201129 released with these changes

  • New borg special remote. This is a new kind of remote, that examines borg backups of git-annex repositories, learns what files have been backed up, and can restore files from the backup and so on. As well as backups, it can be useful for archival storage, since borg can efficiently store many related versions of files.
  • New config annex.stalldetection, remote.name.annex-stalldetection, which can be used to deal with remotes that stall during transfers, or are sometimes too slow to want to use.
  • Support special remotes that are configured with importtree=yes but without exporttree=yes.
  • Fix bug that made the next download after an empty file from a ssh or tor remote fail.
  • Avoid spurious "verification of content failed" message when downloading content from a ssh or tor remote fails due to the remote no longer having a copy of the content.
  • Fix bug that matched include= and exclude= in preferred/required content expressions relative to the current directory, rather than the path from the top of the repository. (Reversion introduced in version 8.20201116.)
  • Fix hang on shutdown of external special remote using ASYNC protocol extension. (Reversion introduced in version 8.20201007.)
  • Guard against running in a repo where annex.uuid is set but annex.version is not set, or vice-versa.
  • Avoid autoinit when a repo does not have annex.version or annex.uuid set, but has a git-annex objects directory, suggesting it was used by git-annex before, and the git config may have been lost.
  • importfeed: Avoid using youtube-dl when a feed does not contain an enclosure, but only a link to an url which youtube-dl does not support.
  • initremote: Prevent enabling encryption with exporttree=yes or importtree=yes.
  • Windows: include= and exclude= containing '/' will also match filenames that are written using '\'. (And vice-versa, but it's better to use '/' for portability.)
  • Fix a bug that could prevent getting files from an importtree=yes remote, because the imported tree was allowed to be garbage collected.
  • stack.yaml: Updated to lts-16.27.
Posted Tue Dec 29 17:52:45 2020

git-annex 8.20201127 released with these changes

  • adjust: New --unlock-present mode which locks files whose content is not present (so the broken symlink is visible), while unlocking files whose content is present.
  • Added annex.adjustedbranchrefresh git config to update adjusted branches set up by git-annex adjust --unlock-present/--hide-missing.
  • Fix hang when an external special remote program exited but the stderr pipe to it was left open, due to a daemon having inherited the file descriptor.
  • Fix a bug that could make resuming a download from the web fail when the entire content of the file is actually already present locally.
  • examinekey: Added a "file" format variable for consistency with find, and for easier scripting.
  • init: When writing hook scripts, set all execute bits, not only the user execute bit.
  • upgrade: Support an edge case upgrading a v5 direct mode repo where nothing had ever been committed to the head branch.
  • Made the test suite significantly less noisy, only displaying command output when something failed.
  • Fix building without the torrent library. Thanks, Kyle Meyer.
  • Fix build on Windows.
  • Prevent windows assistant from trying (and failing) to upgrade itself, which has never been supported on windows.
Posted Fri Nov 27 16:57:43 2020

git-annex 8.20201116 released with these changes

  • move: Fix a regression in the last release that made move --to not honor numcopies settings.
  • sync --content: Fix a bug where a file that was not preferred content could be transferred to a remote. This happened when the file got deleted after the sync started running.
  • Warn when adding a annex symlink or pointer file that uses a key that is not known to the repository, to prevent confusion if the user has copied it from some other repository.
  • examinekey: Added two new format variables: objectpath and objectpointer
  • examinekey: Added --migrate-to-backend
Posted Mon Nov 16 13:39:16 2020

Similar to the yearly git user survey, there is a 2018 git-annex user survey.

If you use git-annex, please take a few minutes to answer the questions!

Since git-annex is seeing increasing use to manage scientific data, the survey also includes some extra questions about that at the end.

Posted Sat Dec 1 15:46:38 2018

git-annex 6.20180626 is an important security fix release.

See the advisory for details about the security holes fixed in this release.

After upgrading git-annex, you should restart any git-annex assistant processes.

Several changes to git-annex's behavior had to be made as part of the security fixes:

  • A security fix has changed git-annex to refuse to download content from some special remotes when the content cannot be verified with a hash check. In particular URL and WORM keys stored on such remotes won't be downloaded. See the documentation of the annex.security.allow-unverified-downloads configuration for how to deal with this if it affects your files.

  • A security fix has changed git-annex to only support http, https, and ftp URL schemes by default. You can enable other URL schemes, at your own risk, using annex.security.allowed-url-schemes.

  • A related security fix prevents git-annex from connecting to http servers (and proxies) on localhost or private networks. This can be overridden, at your own risk, using annex.security.allowed-ip-addresses.

  • Setting annex.web-options no longer is enough to make curl be used, and youtube-dl is also no longer used by default. See the documentation of annex.security.allowed-http-addresses for details and how to enable them.

  • The annex.web-download-command configuration has been removed, use annex.web-options instead.

Posted Tue Jun 26 16:00:19 2018

Similar to the yearly git user survey, there is a 2015 git-annex user survey.

If you use git-annex, please take a few minutes to answer the questions!

Posted Mon Oct 19 20:05:12 2015

Similar to the yearly git user survey, I am doing a 2013 git-annex user survey.

If you use git-annex, please take a few minutes to answer my questions!

Posted Fri Nov 22 17:17:21 2013

Thanks to my recent successful git-annex crowdfunding campaign, $1000 has been set aside to award others for their contributions to git-annex by the end of 2013. This is not a lot of money, but I hope that the reward and recognition will encourage some more people to work on git-annex.

You don't need to know Haskell! You could contribute some interesting and useful special remote hooks, or write better documentation.

On the other hand, if you have learned Haskell, this might be your first chance to make some money with it! Some ideas for things to work on that would be particularly award-worthy:

  • Port git-annex to IOS, using ghc-ios. I don't plan to ever do this myself, but you could make it happen.
  • Get the git-annex assistant working in Windows, building on the existing port to Windows. Otherwise, this is on my roadmap for February.
  • Solve existing bugs or todo items. There are more than I can keep up with.

The amount of the awards will vary depending on the size of the contribution. Since this is getting started later than is ideal, I reserve the right to extend it past the end of the year if I don't get enough participants.

If you'd like to participate in this program, just email me at id@joeyh.name. --Joey

Posted Thu Oct 10 22:02:33 2013

git-annex will be briefly presented at FOSDEM, on Sunday February 4th at 15:40. Details.

Thanks to Richard Hartmann for making this presentation.

Posted Sat Feb 4 18:30:28 2012

Christophe-Marie Duquesne has just announced Sharebox, a FUSE filesystem relying on git-annex:

What are your goals?  
Seamless synchronization "à la dropbox".  
Ability to use with big binary files such as mp3/movies.  
Entirely decentralized.  
Don't use unnecessary space  
Keep it simple: avoid special VCS commands and keep a filesystem  
interface as much as possible.

While still alpha, this is promising. --Joey

Posted Thu Mar 31 18:06:14 2011

Linux Weekly News has a nice article on git-annex in it this week.

Posted Thu Dec 9 15:35:07 2010