This is where announcements of new releases, features, and other news is posted. git-annex users are recommended to subscribe to this page's RSS feed. Also, see security for security announcements.

RSS Atom Add a new post titled:

git-annex 7.20190819 released with these changes

  • New git-lfs special remote, which can be used to store data on any git-lfs server, including github, gitlab, and gogs.
  • Support fully encrypting all data sent to a git-lfs special remote, using a combination of gcrypt to encrypt the git data, and git-annex's encryption of its data.
  • Use the same optimisation for --in=here as has always been used for --in=. rather than the slow code path that unncessarily queries the git-annex branch.
  • Allow setting up a gcrypt special remote with encryption=shared.
  • Fix querying git for object type when operating on a file containing newlines.
  • merge: When run with a branch parameter, merges from that branch. This is especially useful when using an adjusted branch, because it applies the same adjustment to the branch before merging it.
  • init: Install working hook scripts when run on a crippled filesystem and on Windows. If your repository was set up by an old version of git-annex that omitted the hooks, you can simply re-run git-annex init to install them.
  • init: When the repo is already initialized, and --version requests a different version, error out rather than silently not changing the version.
  • S3: Fix encoding when generating public urls of S3 objects.
  • Make git-annex-standalone.deb include the shell completions again.
  • Makefile: Changed default zsh completion location to zsh default fpath. Systems such as Debian that have overridden the default fpath will need to set ZSH_COMPLETIONS_PATH.
  • test: Add pass using adjusted unlocked branch.
  • Fix intermittent failure of the test suite, where its repeated opening and writing to the sqlite database somehow caused inode cache information to occasionally be lost.
  • Fix several test suite failures on Windows.
  • Windows installer: Always install to 64 bit program files directory, since it needs 64 bit git now.
  • Build with silently-1.2.5.1 on Windows; the old one used "NUL" device which is not supported with recent versions of ghc.
Posted Mon Aug 19 16:27:31 2019

git-annex 7.20190730 released with these changes

  • Improved probing when CoW copies can be made between files on the same drive. Now supports CoW between BTRFS subvolumes. And, falls back to rsync instead of using cp when CoW won't work, eg copies between repos on the same EXT4 filesystem.
  • Add BLAKE2BP512 and BLAKE2BP512E backends, using a blake2 variant optimised for 4-way CPUs.
  • Support running v7 upgrade in a repo where there is no branch checked out, but HEAD is set directly to some other ref.
  • Windows build no longer ships with a copy of rsync, since that is only used any more to access rsync special remotes or remotes with a very old version of git-annex-shell.
  • Windows build is now 64 bit, and using it with the 64 bit git for Windows is fully supported.
  • Windows problems with long filenames should be fixed now, since the Windows build is made with a newer ghc version that works around the problems.
  • stack.yaml: Build with http-client-0.5.14 to get a bug fix to http header parsing.
  • Drop support for building with ghc older than 8.4.4, and with older versions of serveral haskell libraries.
  • Support building with socks-0.6 and persistant-template-2.7.
  • Corrected some license statements. Thanks, Sean Whitton.
Posted Tue Jul 30 20:22:08 2019

git-annex 7.20190708 released with these changes

  • Fix find --json to output json once more.
Posted Mon Jul 8 12:59:04 2019

git-annex 7.20190626 released with these changes

  • get, move, copy, sync: When -J or annex.jobs has enabled concurrency, checksum verification uses a separate job pool than is used for downloads, to keep bandwidth saturated.
  • Other commands also run their cleanup phase using a separate job pool than their perform phase, which may make some of them somewhat faster when running concurrently as well.
  • When downloading an url and the destination file exists but is empty, avoid using http range to resume, since a range "bytes=0-" is an unusual edge case that it's best to avoid relying on working. This is known to fix a case where importfeed downloaded a partial feed from such a server.
  • importfeed: When there's a problem parsing the feed, --debug will output the feed content that was downloaded.
  • init: Fix a reversion in the last release that prevented automatically generating and setting a description for the repository.
  • add: Display progress meter when hashing files.
  • add: Support --json-progress option.
  • The Linux standalone arm build now works again on CPU versions below arm6. Thanks to Emanuele Olivetti, Ilias Tsitsimpis, Bernhard Übelacker, and Adrian Bunk for fixing ghc in Debian (bug #928882).
  • OSX dmg: Put git-annex's version in the Info.plist file.
Posted Wed Jun 26 16:31:21 2019

git-annex 7.20190615 released with these changes

  • Fixed bug that caused git-annex to fail to add a file when another git-annex process cleaned up the temp directory it was using.
  • Makefile: Added install-completions to install target.
  • Added the ability to run one job per CPU (core), by setting annex.jobs=cpus, or using option --jobs=cpus or -Jcpus.
  • Honor preferred content of a special remote when exporting trees to it; unwanted files are filtered out of the tree that is exported.
  • Importing from a special remote honors its preferred content too; unwanted files are not imported. But, some preferred content expressions can't be checked before files are imported, and trying to import with such an expression will fail.
  • Don't try to import .git directories from special remotes, because git does not support storing git repositories inside a git repository.
  • Improve shape of commit tree when importing from unversioned special remotes.
  • init: When the repository already has a description, don't change it.
  • describe: When run with no description parameter it used to set the description to "", now it will error out.
  • Android: Improve installation process when the user's login shell is not bash.
  • When a remote is configured to be readonly, don't allow changing what's exported to it.
  • Renamed annex.security.allowed-http-addresses to annex.security.allowed-ip-addresses because it is not really specific to the http protocol, also limiting eg, git-annex's use of ftp. The old name for the config will still work.
  • Add back support for ftp urls, which was disabled as part of the fix for security hole CVE-2018-10857 (except for configurations which enabled curl and bypassed public IP address restrictions). Now it will work if allowed by annex.security.allowed-ip-addresses.
  • Avoid a delay at startup when concurrency is enabled and there are rsync or gcrypt special remotes, which was caused by git-annex opening a ssh connection to the remote too early.
Posted Sat Jun 15 16:39:58 2019

Similar to the yearly git user survey, there is a 2018 git-annex user survey.

If you use git-annex, please take a few minutes to answer the questions!

Since git-annex is seeing increasing use to manage scientific data, the survey also includes some extra questions about that at the end.

Posted Sat Dec 1 15:46:38 2018

git-annex 6.20180626 is an important security fix release.

See the advisory for details about the security holes fixed in this release.

After upgrading git-annex, you should restart any git-annex assistant processes.

Several changes to git-annex's behavior had to be made as part of the security fixes:

  • A security fix has changed git-annex to refuse to download content from some special remotes when the content cannot be verified with a hash check. In particular URL and WORM keys stored on such remotes won't be downloaded. See the documentation of the annex.security.allow-unverified-downloads configuration for how to deal with this if it affects your files.

  • A security fix has changed git-annex to only support http, https, and ftp URL schemes by default. You can enable other URL schemes, at your own risk, using annex.security.allowed-url-schemes.

  • A related security fix prevents git-annex from connecting to http servers (and proxies) on localhost or private networks. This can be overridden, at your own risk, using annex.security.allowed-ip-addresses.

  • Setting annex.web-options no longer is enough to make curl be used, and youtube-dl is also no longer used by default. See the documentation of annex.security.allowed-http-addresses for details and how to enable them.

  • The annex.web-download-command configuration has been removed, use annex.web-options instead.

Posted Tue Jun 26 16:00:19 2018

Similar to the yearly git user survey, there is a 2015 git-annex user survey.

If you use git-annex, please take a few minutes to answer the questions!

Posted Mon Oct 19 20:05:12 2015

Similar to the yearly git user survey, I am doing a 2013 git-annex user survey.

If you use git-annex, please take a few minutes to answer my questions!

Posted Fri Nov 22 17:17:21 2013

Thanks to my recent successful git-annex crowdfunding campaign, $1000 has been set aside to award others for their contributions to git-annex by the end of 2013. This is not a lot of money, but I hope that the reward and recognition will encourage some more people to work on git-annex.

You don't need to know Haskell! You could contribute some interesting and useful special remote hooks, or write better documentation.

On the other hand, if you have learned Haskell, this might be your first chance to make some money with it! Some ideas for things to work on that would be particularly award-worthy:

  • Port git-annex to IOS, using ghc-ios. I don't plan to ever do this myself, but you could make it happen.
  • Get the git-annex assistant working in Windows, building on the existing port to Windows. Otherwise, this is on my roadmap for February.
  • Solve existing bugs or todo items. There are more than I can keep up with.

The amount of the awards will vary depending on the size of the contribution. Since this is getting started later than is ideal, I reserve the right to extend it past the end of the year if I don't get enough participants.

If you'd like to participate in this program, just email me at id@joeyh.name. --Joey

Posted Thu Oct 10 22:02:33 2013

git-annex will be briefly presented at FOSDEM, on Sunday February 4th at 15:40. Details.

Thanks to Richard Hartmann for making this presentation.

Posted Sat Feb 4 18:30:28 2012

Christophe-Marie Duquesne has just announced Sharebox, a FUSE filesystem relying on git-annex:

What are your goals?  
Seamless synchronization "à la dropbox".  
Ability to use with big binary files such as mp3/movies.  
Entirely decentralized.  
Don't use unnecessary space  
Keep it simple: avoid special VCS commands and keep a filesystem  
interface as much as possible.

While still alpha, this is promising. --Joey

Posted Thu Mar 31 18:06:14 2011

Linux Weekly News has a nice article on git-annex in it this week.

Posted Thu Dec 9 15:35:07 2010