This is where announcements of new releases, features, and other news is posted. git-annex users are recommended to subscribe to this page's RSS feed. Also, see security for security announcements.
git-annex 10.20240701 released with these changes
- git-annex remotes can now act as proxies that provide access to their remotes. Configure this with remote.name.annex-proxy and the git-annex update proxy command.
- Clusters are now supported. These are collections of nodes that can be accessed as a single entity, accessed by one or more gateway repositories.
- Added git-annex initcluster, updatecluster, and extendcluster commands.
- Fix a bug where interrupting git-annex while it is updating the git-annex branch for an export could later lead to git fsck complaining about missing tree objects.
- Tab completion of options like --from now includes special remotes, as well as proxied remotes and clusters.
- Tab completion of many commands like info and trust now includes remotes.
- P2P protocol version 2.
- Fix Windows build with Win32 2.13.4+ Thanks, Oleg Tolmatcev
- When --debugfilter or annex.debugfilter is set, avoid propigating debug output from git-annex-shell, since it cannot be filtered.
git-annex 10.20240531 released with these changes
- git-remote-annex: New program which allows pushing a git repo to a git-annex special remote, and cloning from a special remote. (Based on Michael Hanke's git-remote-datalad-annex.)
- initremote, enableremote: Added --with-url to enable using git-remote-annex.
- When building an adjusted unlocked branch, make pointer files executable when the annex object file is executable.
- group: Added --list option.
- fsck: Fix recent reversion that made it say it was checksumming files whose content is not present.
- Avoid the --fast option preventing checksumming in some cases it was not supposed to.
- testremote: Really fsck downloaded objects.
- Typo fixes. Thanks, Yaroslav Halchenko
git-annex 10.20240430 released with these changes
- Bug fix: While redundant concurrent transfers were already prevented in most cases, it failed to prevent the case where two different repositories were sending the same content to the same repository.
- addurl, importfeed: Added --verifiable option, which improves the safety of --fast or --relaxed by letting the content of annexed files be verified with a checksum that is calculated on a later download from the web. This will become the default later.
- Added rclone special remote, which can be used without needing to install the git-annex-remote-rclone program. This needs a forthcoming version of rclone (1.67.0), which supports "rclone gitannex".
- sync, assist, import: Allow -m option to be specified multiple times, to provide additional paragraphs for the commit message.
- reregisterurl: New command that can change an url from being used by a special remote to being used by the web remote.
- annex.maxextensions configuration controls how many filename extensions to preserve.
- find: Fix --help for --copies. Thanks, Gergely Risko
- Windows: Fix escaping output to terminal when using old versions of MinTTY.
- Added dependency on unbounded-delays.
Since 24.03.2024, hellotux.com now offers git-annex-branded shirts, hoodies and backpacks. Just in time, right before the distribits meeting.
This cooperation was initiated by Yann Büchau (nobodyinperson).
git-annex 10.20240227 released with these changes
- importfeed: Added --scrape option, which uses yt-dlp to screen scrape the equivilant of an RSS feed.
- importfeed --force: Don't treat it as a failure when an already downloaded file exists. (Fixes a behavior change introduced in 10.20230626.)
- importfeed --force: Avoid creating duplicates of existing already downloaded files when yt-dlp or a special remote was used.
- addurl, importfeed: Added --raw-except option.
- stack.yaml: Update to lts-22.9 and use crypton.
- assistant, undo: When committing, let the usual git commit hooks run.
- Added annex.commitmessage-command config.
- pre-commit: Avoid committing the git-annex branch (except when a commit is made in a view, which changes metadata).
- Pass --no-warnings to yt-dlp.
git-annex 10.20240129 released with these changes
- info: Added "annex sizes of repositories" table to the overall display.
- import: Sped up import from special remotes.
- import: Added --message/-m option.
- Support using commands that implement the Stateless OpenPGP command line interface, as an alternative to gpg. Currently only supported for encryption=shared special remotes, when annex.shared-sop-command is configured.
- test: Test a specified Stateless OpenPGP command when run with eg --test-git-config annex.shared-sop-command=sqop
- Improve disk free space checking when transferring unsized keys to local git remotes.
- Added configs annex.stalldetection-download, annex.stalldetection-upload, annex.bwlimit-download, annex.bwlimit-upload, and similar per-remote configs.
- Improve annex.stalldetection to handle remotes that update progress less frequently than the configured time period.
- external: Monitor file size when getting content from external special remotes and use that to update the progress meter, in case the external special remote program does not report progress.
- Added --expected-present file matching option.
- webapp: Added --port option, and annex.port config.
- assistant: When generating a gpg secret key, avoid hardcoding the key algorithm and size.
We are happy to announce that the call for participation for the first ever Distribits meeting is now online at https://distribits.live/
This meeting is organized by the folks behind git-annex and DataLad. We aim to bring together enthusiasts of tools and workflows in the domain of distributed data.
We are looking forward to April 2024 and to meeting people from everywhere, online and in Düsseldorf.
Registration is open now and until October 15. Please consider submitting a talk if you are doing something interesting or unusual with git-annex.
Similar to the yearly git user survey, there is a 2018 git-annex user survey.
If you use git-annex, please take a few minutes to answer the questions!
Since git-annex is seeing increasing use to manage scientific data, the survey also includes some extra questions about that at the end.
git-annex 6.20180626 is an important security fix release.
See the advisory for details about the security holes fixed in this release.
After upgrading git-annex, you should restart any git-annex assistant processes.
Several changes to git-annex's behavior had to be made as part of the security fixes:
A security fix has changed git-annex to refuse to download content from some special remotes when the content cannot be verified with a hash check. In particular URL and WORM keys stored on such remotes won't be downloaded. See the documentation of the annex.security.allow-unverified-downloads configuration for how to deal with this if it affects your files.
A security fix has changed git-annex to only support http, https, and ftp URL schemes by default. You can enable other URL schemes, at your own risk, using annex.security.allowed-url-schemes.
A related security fix prevents git-annex from connecting to http servers (and proxies) on localhost or private networks. This can be overridden, at your own risk, using annex.security.allowed-ip-addresses.
Setting annex.web-options no longer is enough to make curl be used, and youtube-dl is also no longer used by default. See the documentation of annex.security.allowed-http-addresses for details and how to enable them.
The annex.web-download-command configuration has been removed, use annex.web-options instead.
Similar to the yearly git user survey, there is a 2015 git-annex user survey.
If you use git-annex, please take a few minutes to answer the questions!
Similar to the yearly git user survey, I am doing a 2013 git-annex user survey.
If you use git-annex, please take a few minutes to answer my questions!
Thanks to my recent successful git-annex crowdfunding campaign, $1000 has been set aside to award others for their contributions to git-annex by the end of 2013. This is not a lot of money, but I hope that the reward and recognition will encourage some more people to work on git-annex.
You don't need to know Haskell! You could contribute some interesting and useful special remote hooks, or write better documentation.
On the other hand, if you have learned Haskell, this might be your first chance to make some money with it! Some ideas for things to work on that would be particularly award-worthy:
- Port git-annex to IOS, using ghc-ios. I don't plan to ever do this myself, but you could make it happen.
- Get the git-annex assistant working in Windows, building on the existing port to Windows. Otherwise, this is on my roadmap for February.
- Solve existing bugs or todo items. There are more than I can keep up with.
The amount of the awards will vary depending on the size of the contribution. Since this is getting started later than is ideal, I reserve the right to extend it past the end of the year if I don't get enough participants.
If you'd like to participate in this program, just email me at id@joeyh.name. --Joey
git-annex will be briefly presented at FOSDEM, on Sunday February 4th at 15:40. Details.
Thanks to Richard Hartmann for making this presentation.
Christophe-Marie Duquesne has just announced Sharebox, a FUSE filesystem relying on git-annex:
What are your goals? Seamless synchronization "à la dropbox". Ability to use with big binary files such as mp3/movies. Entirely decentralized. Don't use unnecessary space Keep it simple: avoid special VCS commands and keep a filesystem interface as much as possible.
While still alpha, this is promising. --Joey
Linux Weekly News has a nice article on git-annex in it this week.