newsgit-annexhttp://git-annex.branchable.com/news/git-annexikiwiki2024-03-25T06:27:47Zgit-annex shirts now available at hellotux.comhttp://git-annex.branchable.com/news/git-annex_shirts_now_available_at_hellotux.com/2024-03-25T06:27:47Z2024-03-25T06:27:47Z
<p>Since 24.03.2024, <a href="https://www.hellotux.com/git-annex">hellotux.com</a> now offers git-annex-branded shirts, hoodies and backpacks. Just in time, right before the <a href="https://distribits.live/">distribits</a> meeting.</p>
<p>This cooperation was initiated by <a href="https://git-annex.branchable.com/users/nobodyinperson/">Yann Büchau (nobodyinperson)</a>.</p>
version 10.20240227http://git-annex.branchable.com/news/version_10.20240227/2024-02-27T17:02:26Z2024-02-27T17:02:26Z
<p>git-annex 10.20240227 released with <a class="toggle" href="http://git-annex.branchable.com/news/#news-version-10.20240227.default">these changes</a></p>
<div class="toggleable" id="news-version-10.20240227.default"></div>
<ul>
<li>importfeed: Added --scrape option, which uses yt-dlp to screen scrape
the equivilant of an RSS feed.</li>
<li>importfeed --force: Don't treat it as a failure when an already
downloaded file exists. (Fixes a behavior change introduced in
10.20230626.)</li>
<li>importfeed --force: Avoid creating duplicates of existing
already downloaded files when yt-dlp or a special remote was used.</li>
<li>addurl, importfeed: Added --raw-except option.</li>
<li>stack.yaml: Update to lts-22.9 and use crypton.</li>
<li>assistant, undo: When committing, let the usual git commit
hooks run.</li>
<li>Added annex.commitmessage-command config.</li>
<li>pre-commit: Avoid committing the git-annex branch
(except when a commit is made in a view, which changes metadata).</li>
<li>Pass --no-warnings to yt-dlp.</li>
</ul>
<div class="toggleableend"></div>
version 10.20240129http://git-annex.branchable.com/news/version_10.20240129/2024-01-29T18:12:23Z2024-01-29T18:12:23Z
<p>git-annex 10.20240129 released with <a class="toggle" href="http://git-annex.branchable.com/news/#news-version-10.20240129.default">these changes</a></p>
<div class="toggleable" id="news-version-10.20240129.default"></div>
<ul>
<li>info: Added "annex sizes of repositories" table to the overall display.</li>
<li>import: Sped up import from special remotes.</li>
<li>import: Added --message/-m option.</li>
<li>Support using commands that implement the Stateless OpenPGP command line
interface, as an alternative to gpg.
Currently only supported for encryption=shared special remotes,
when annex.shared-sop-command is configured.</li>
<li>test: Test a specified Stateless OpenPGP command when
run with eg --test-git-config annex.shared-sop-command=sqop</li>
<li>Improve disk free space checking when transferring unsized keys to
local git remotes.</li>
<li>Added configs annex.stalldetection-download, annex.stalldetection-upload,
annex.bwlimit-download, annex.bwlimit-upload,
and similar per-remote configs.</li>
<li>Improve annex.stalldetection to handle remotes that update progress
less frequently than the configured time period.</li>
<li>external: Monitor file size when getting content from external
special remotes and use that to update the progress meter,
in case the external special remote program does not report progress.</li>
<li>Added --expected-present file matching option.</li>
<li>webapp: Added --port option, and annex.port config.</li>
<li>assistant: When generating a gpg secret key, avoid hardcoding the
key algorithm and size.</li>
</ul>
<div class="toggleableend"></div>
version 10.20231227http://git-annex.branchable.com/news/version_10.20231227/2023-12-27T23:28:03Z2023-12-27T23:28:03Z
<p>git-annex 10.20231227 released with <a class="toggle" href="http://git-annex.branchable.com/news/#news-version-10.20231227.default">these changes</a></p>
<div class="toggleable" id="news-version-10.20231227.default"></div>
<ul>
<li>migrate: Support distributed migrations by recording each migration,
and adding a --update option that updates the local repository
incrementally, hard linking annex objects to their new keys.</li>
<li>pull, sync: When operating on content, automatically handle
distributed migrations.</li>
<li>Added annex.syncmigrations config that can be set to false to prevent
pull and sync from migrating object content.</li>
<li>migrate: Added --apply option that (re)applies all recorded
distributed migrations to the objects in repository.</li>
<li>migrate: Support adding size to URL keys that were added with
--relaxed, by running eg: git-annex migrate --backend=URL foo</li>
<li>When importing from a special remote, support preferred content
expressions that use terms that match on keys (eg "present", "copies=1").
Such terms are ignored when importing, since the key is not known yet.
Before, such expressions caused the import to fail.</li>
<li>Support git-annex copy/move --from-anywhere --to remote.</li>
<li>Make git-annex get/copy/move --from foo override configuration of
remote.foo.annex-ignore, as documented.</li>
<li>Lower precision of timestamps in git-annex branch, which can reduce the
size of the branch by up to 8%.</li>
<li>sync: Fix locking problems during merge when annex.pidlock is set.</li>
<li>Avoid a problem with temp file names ending in "." on certian
filesystems that have problems with such filenames.</li>
<li>sync, push: Avoid trying to send individual files to special remotes
configured with importtree=yes exporttree=no, which would always fail.</li>
<li>Fix a crash opening sqlite databases when run in a non-unicode locale.
(Needs persistent-sqlite 2.13.3.)</li>
</ul>
<div class="toggleableend"></div>
version 10.20231129http://git-annex.branchable.com/news/version_10.20231129/2023-11-29T20:01:14Z2023-11-29T20:01:14Z
<p>git-annex 10.20231129 released with <a class="toggle" href="http://git-annex.branchable.com/news/#news-version-10.20231129.default">these changes</a></p>
<div class="toggleable" id="news-version-10.20231129.default"></div>
<ul>
<li>Fix bug in git-annex copy --from --to that skipped files that were
locally present.</li>
<li>Make git-annex copy --from --to --fast actually fast.</li>
<li>Fix crash of enableremote when the special remote has embedcreds=yes.</li>
<li>Ignore directories and other unusual files in .git/annex/journal/</li>
<li>info: Added calculation of combined annex size of all repositories.</li>
<li>log: Added options --sizesof, --sizes and --totalsizes that
display how the size of repositories changed over time.</li>
<li>log: Added options --interval, --bytes, --received, and --gnuplot
to tune the output of the above added options.</li>
<li>findkeys: Support --largerthan and --smallerthan.</li>
<li>importfeed: Use caching database to avoid needing to list urls
on every run, and avoid using too much memory.</li>
<li>Improve memory use of --all when using annex.private.</li>
<li>lookupkey: Sped up --batch.</li>
<li>Windows: Consistently avoid ending standard output lines with CR.
This matches the behavior of git on Windows.</li>
<li>Windows: Fix CRLF handling in some log files.</li>
<li>Windows: When git-annex init is installing hook scripts, it will
avoid ending lines with CR for portability. Existing hook scripts
that do have CR line endings will not be changed.</li>
</ul>
<div class="toggleableend"></div>
version 10.20230926http://git-annex.branchable.com/news/version_10.20230926/2023-09-26T17:30:03Z2023-09-26T17:30:03Z
<p>git-annex 10.20230926 released with <a class="toggle" href="http://git-annex.branchable.com/news/#news-version-10.20230926.default">these changes</a></p>
<div class="toggleable" id="news-version-10.20230926.default"></div>
<ul>
<li>Fix more breakage caused by git's fix for CVE-2022-24765, this time
involving a remote (either local or ssh) that is a repository not owned
by the current user.</li>
<li>Fix using git remotes that are bare when git is configured with
safe.bareRepository = explicit.</li>
<li>Fix linker optimisation in linux standalone tarballs.</li>
<li>adb: Avoid some problems with unusual characters in exporttree
filenames that confuse adb shell commands.</li>
<li>push: When on an adjusted branch, propagate changes to parent branch
before updating export remotes.</li>
<li>lookupkey: Added --ref option.</li>
<li>enableremote: Avoid overwriting existing git remote when passed the uuid
of a specialremote that was earlier initialized with the same name.</li>
<li>Support being built with crypton rather than the no-longer maintained
cryptonite.</li>
<li>Removed the vendored git-lfs and the GitLfs build flag.</li>
</ul>
<div class="toggleableend"></div>
Distribits meetinghttp://git-annex.branchable.com/news/Distribits_meeting/2023-09-14T16:38:52Z2023-09-14T16:38:52Z
<p>We are happy to announce that the call for participation for the first ever
Distribits meeting is now online at <a href="https://distribits.live/">https://distribits.live/</a></p>
<p>This meeting is organized by the folks behind git-annex and DataLad. We aim
to bring together enthusiasts of tools and workflows in the domain of
distributed data.</p>
<p>We are looking forward to April 2024 and to meeting people from everywhere,
online and in Düsseldorf.</p>
<p>Registration is open now and until October 15. Please consider submitting a
talk if you are doing something interesting or unusual with git-annex.</p>
2018 git-annex user surveyhttp://git-annex.branchable.com/news/2018_git-annex_user_survey/2019-01-21T15:42:51Z2018-12-01T15:46:38Z
<p>Similar to the yearly git user survey, there is a
<a href="http://git-annex-survey.branchable.com/polls/2018/">2018 git-annex user survey</a>.</p>
<p>If you use git-annex, please take a few minutes to answer the questions!</p>
<p>Since git-annex is seeing increasing use to manage scientific data, the
survey also includes some extra questions about that at the end.</p>
security fix releasehttp://git-annex.branchable.com/news/security_fix_release/2019-05-30T20:07:23Z2018-06-26T16:00:19Z
<p>git-annex 6.20180626 is an important security fix release.</p>
<p>See <a href="http://git-annex.branchable.com/security/CVE-2018-10857_and_CVE-2018-10859/">the advisory</a>
for details about the security holes fixed in this release.</p>
<p>After upgrading git-annex, you should restart any git-annex assistant
processes.</p>
<p>Several changes to git-annex's behavior had to be made as part of the
security fixes:</p>
<ul>
<li><p>A security fix has changed git-annex to refuse to download content from
some special remotes when the content cannot be verified with a hash check.
In particular URL and WORM keys stored on such remotes won't be downloaded.
See the documentation of the annex.security.allow-unverified-downloads
configuration for how to deal with this if it affects your files.</p></li>
<li><p>A security fix has changed git-annex to only support http, https, and ftp
URL schemes by default. You can enable other URL schemes, at your own risk,
using annex.security.allowed-url-schemes.</p></li>
<li><p>A related security fix prevents git-annex from connecting to http
servers (and proxies) on localhost or private networks. This can
be overridden, at your own risk, using annex.security.allowed-ip-addresses.</p></li>
<li><p>Setting annex.web-options no longer is enough to make curl be used,
and youtube-dl is also no longer used by default. See the
documentation of annex.security.allowed-http-addresses for
details and how to enable them.</p></li>
<li><p>The annex.web-download-command configuration has been removed,
use annex.web-options instead.</p></li>
</ul>
2015 git-annex user surveyhttp://git-annex.branchable.com/news/2015_git-annex_user_survey/2015-10-19T20:05:12Z2015-10-19T20:05:12Z
<p>Similar to the yearly git user survey, there is a
<a href="http://git-annex-survey.branchable.com/polls/2015/">2015 git-annex user survey</a>.</p>
<p>If you use git-annex,
please take a few minutes to answer the questions!</p>
2013 git-annex user surveyhttp://git-annex.branchable.com/news/2013_git-annex_user_survey/2013-11-27T22:47:37Z2013-11-22T17:17:21Z
<p>Similar to the yearly git user survey, I am doing a
<a href="http://git-annex-survey.branchable.com/polls/2013/">2013 git-annex user survey</a>.</p>
<p>If you use git-annex,
please take a few minutes to answer my questions!</p>
git annex fall of codehttp://git-annex.branchable.com/news/git_annex_fall_of_code/2013-11-27T22:47:37Z2013-10-10T22:02:33Z
<p>Thanks to my recent successful git-annex
<a href="http://campaign.joeyh.name/">crowdfunding campaign</a>, $1000 has been set
aside to award others for their contributions to git-annex by
the end of 2013. This is not a lot of money, but I hope that the
reward and recognition will encourage some more people to work on git-annex.</p>
<p>You don't need to know Haskell! You could contribute some interesting and
useful special remote hooks, or write better documentation.</p>
<p>On the other hand, if you have learned Haskell, this might be your first
chance to make some money with it! Some ideas for things to work on that
would be particularly award-worthy:</p>
<ul>
<li>Port git-annex to IOS, using <a href="https://github.com/ghc-ios">ghc-ios</a>.
I don't plan to ever do this myself, but you could make it happen.</li>
<li>Get the git-annex assistant working in Windows, building on the existing
port to Windows. Otherwise, this is on my roadmap for February.</li>
<li>Solve existing <a href="http://git-annex.branchable.com/bugs/">bugs</a> or <a href="http://git-annex.branchable.com/todo/">todo</a> items. There are more than I can
keep up with.</li>
</ul>
<p>The amount of the awards will vary depending on the size of the
contribution. Since this is getting started later than is ideal,
I reserve the right to extend it past the end of the year if I don't get
enough participants.</p>
<p>If you'd like to participate in this program, just email me at
<a href="mailto:id@joeyh.name">id@joeyh.name</a>. --<a href="http://git-annex.branchable.com/users/joey/">Joey</a></p>
Presentation at FOSDEMhttp://git-annex.branchable.com/news/Presentation_at_FOSDEM/2013-11-27T22:47:37Z2012-02-04T18:30:28Z
<p>git-annex will be briefly presented at FOSDEM, on Sunday February 4th at 15:40.
<a href="http://fosdem.org/2012/schedule/event/gitannex">Details</a>.</p>
<p>Thanks to Richard Hartmann for making this presentation.</p>
sharebox: a FUSE filesystem for git-annexhttp://git-annex.branchable.com/news/sharebox_a_FUSE_filesystem_for_git-annex/2013-11-27T22:47:37Z2011-03-31T18:06:14Z
<p>Christophe-Marie Duquesne has just announced
<a href="https://github.com/chmduquesne/sharebox-fs">Sharebox</a>, a FUSE filesystem
relying on git-annex:</p>
<blockquote>
<pre>
What are your goals?
Seamless synchronization "à la dropbox".
Ability to use with big binary files such as mp3/movies.
Entirely decentralized.
Don't use unnecessary space
Keep it simple: avoid special VCS commands and keep a filesystem
interface as much as possible.
</pre>
</blockquote>
<p>While still alpha, this is promising. --<a href="http://git-annex.branchable.com/users/joey/">Joey</a></p>
LWN articlehttp://git-annex.branchable.com/news/LWN_article/2013-11-27T22:47:37Z2010-12-09T15:35:07Z
<p><a href="http://lwn.net/">Linux Weekly News</a> has a nice
<a href="http://lwn.net/Articles/418337/">article on git-annex</a> in it this week.</p>