git-annex allows managing files with git, without checking the file contents into git. While that may seem paradoxical, it is useful when dealing with files larger than git can currently easily handle, whether due to limitations in memory, time, or disk space.
git-annex is designed for git users who love the command line. For everyone else, the git-annex assistant turns git-annex into an easy to use folder synchroniser.
To get a feel for git-annex, see the walkthrough.
use case: The Archivist
Bob has many drives to archive his data, most of them kept offline, in a safe place.
With git-annex, Bob has a single directory tree that includes all his files, even if their content is being stored offline. He can reorganize his files using that tree, committing new versions to git, without worry about accidentally deleting anything.
When Bob needs access to some files, git-annex can tell him which drive(s)
they're on, and easily make them available. Indeed, every drive knows what
is on every other drive.
Bob thinks long-term, and so he appreciates that git-annex uses a simple
repository format. He knows his files will be accessible in the future
even if the world has forgotten about git-annex and git.
Run in a cron job, git-annex adds new files to archival drives at night. It
also helps Bob keep track of intentional and unintentional copies of
files, and logs information he can use to decide when it's time to duplicate
the content of old drives.
use case: The Nomad
Alice is always on the move, often with her trusty netbook and a small handheld terabyte USB drive, or a smaller USB keydrive. She has a server out there on the net. She stores data, encrypted in the Cloud.
All these things can have different files on them, but Alice no longer
has to deal with the tedious process of keeping them manually in sync,
or remembering where she put a file. git-annex manages all these data
sources as if they were git remotes.
When she has 1 bar on her cell, Alice queues up interesting files on her
server for later. At a coffee shop, she has git-annex download them to her
USB drive. High in the sky or in a remote cabin, she catches up on
podcasts, videos, and games, first letting git-annex copy them from
her USB drive to the netbook (this saves battery power).
When she's done, she tells git-annex which to keep and which to remove.
They're all removed from her netbook to save space, and Alice knows
that next time she syncs up to the net, her changes will be synced back
to her server.
If that describes you, or if you're some from column A and some from column B, then git-annex may be the tool you've been looking for to expand from keeping all your small important files in git, to managing your large files with git.
Posted Thu Feb 19 18:55:12 2015
Posted Thu Feb 5 18:34:34 2015
day 258 database branch merged
Posted Sun Feb 22 23:54:47 2015
day 257 release day
Posted Thu Feb 19 22:45:55 2015
day 256 sqlite concurrency argh
Posted Wed Feb 18 21:57:07 2015
day 255 sqlite concurrent writers problem
Posted Tue Feb 17 21:13:13 2015
day 254 sqlite for incremental fsck
Posted Mon Feb 16 21:16:38 2015
git-annex assistant lan
Posted Wed Jun 4 16:49:34 2014
git-annex views demo
Posted Thu Feb 20 17:23:07 2014
Recent forum posts
Huge differences in sync times in different directories of same machines
Posted Mon Mar 2 01:39:06 2015
Assistant: run with "sync --fast" to automatically use only available remotes
Posted Sun Mar 1 12:30:53 2015
View special remote information?
Posted Sat Feb 28 12:37:31 2015
Posted Fri Feb 27 17:34:04 2015
Android: unusably slow with moderately sized repositories
Posted Thu Feb 26 09:33:57 2015