joey

git-annex/ users/ joey

Edit
RecentChanges
History
Preferences
Branchable
1 comment

install
assistant
walkthrough
tips
bugs
todo
forum
comments
contact
thanks

Joey Hess id@joeyh.name
https://joeyh.name/

RSS Atom

Hey Joey,

figured this might be the right place to drop a heartily "Thank You!" for your work regarding git-annex (as well for your contributions to Debian and the FLOSS universe in general).

I'm still in the process of trying to wrap my head around the git-annex complex to find the right(TM) implementation for my use case. For me, git-annex strives for essentials, i.e. future-proving, wide applicability and others. Steep learning curve for the diligent user trying to find the right way the first time w/o losing data while using it.

Best prove of a successful and sustainable piece of software seems to be the diversity of use cases others find to apply it to. Looking around the web and seeing the diversity of real and serious git-annex applications is just plain amazing.

cheers

Comment by 4omecha — Thu Oct 4 14:19:17 2018

Remove comment

Links: Android/oldcomments bugs/ impossible to switch repositories on android in webapp bugs/"Adding 4923 files" is really slow bugs/"Unsupported url scheme" message when trying to cconnect to ftp server bugs/"content is locked" with git-annex-drop -J48 bugs/"git update-index --refresh bigfile" fails with "fatal: Out of memory, realloc failed" bugs/"git-annex: direct: 1 failed" on Windows bugs/"sha256sum failed" for some files with newest Android client bugs/'annex add' locks unmodified file in V5 but not V6 bugs/'web' remote does not work on Android ... bugs/[Android] "Make Camera Repository" button goes to blank page bugs/[PATCH] Build Build/InstallDesktopFile at "make all" time bugs/[PATCH] Cosmetic: clarify a warning message bugs/[PATCH] Cosmetic: only print ikiwiki command if it's run bugs/20151116 tests fail on OS X bugs/3 tests fail while trying to build fresh git annex 6.20181011+git109-gff9ba1f4d bugs/7.20181105+git172-g76fc9af4 not buildable bugs/7.20181211+git29-gab4a1bed9 fails tests during neurodebian build bugs/8 unit tests fail bugs/Aborts with SQLite error when dropping contents bugs/Add custom-setup stanza to .cabal file bugs/Add day to metadata. bugs/Add explicit retries for curl/wget on "transient" errors? bugs/Adding metadata bugs/Android 4.4 install fails with permission denied errors bugs/Android 6.0 compatibility bugs/Android CM 5.1 ANDROID_ROOT not set bugs/Android cannot setup gitlab repo due to ECDSA key bugs/Android installation is missing $PATH setup bugs/Android: Cannot create repo on external sd card bugs/Android: use /data/… for git-annex.home? bugs/Assumes OpenSSH version newer than debian stable bugs/Bash completion of filenames with spaces bugs/Build failure: Utility/QuickCheck.hs:38:10: error: Duplicate instance declarations bugs/CFBundleShortVersionString is not incremented with git-annex.dmg releases (downloads.kitenet.net) bugs/Can't add a git repo to git annex: "Invalid path repo/.git/X" for many X bugs/Can't add remotes through the web assistant bugs/Can't compile on FreeBSD: Issues with System.Posix.Files bugs/Can't compile on FreeBSD: alex, StateVar, SafeSemaphore, IfElse fail bugs/Can't use adjusted branch in v6, if submodule already is using this feature bugs/Cannot build with GHC 8.2.1 bugs/Cannot build with aws 0.17.1 bugs/Cannot clone an annex bugs/Corrupted drive: Assistant seems consider files deleted and deletes them elsewhere too bugs/Default startup command bugs/Errors on Android: referenceTable GDEF length=778, referenceTable GSUB length=6388, referenceTable GPOS length=76868 bugs/Excessively long temp names preventing "get" on Windows bugs/Export fails for files directly in git repo bugs/Exporting subdirs fails bugs/Failing to execute bash remotes windows bugs/GHC 8.4.3 build failure in Types/DesktopNotify.hs bugs/GIT_ANNEX_SHELL_DIRECTORY won't match bugs/GPG subkeys bugs/Git-annex not properly detecting symlink capability in CryFS bugs/Handling of files inside and outside archive directory at the same time bugs/Hard links not synced in direct mode bugs/How to clone git-annex? bugs/Importing_Commands_Destructive_by_default bugs/Incorrect escaping of file names for smudging bugs/Issue on OSX with some system limits bugs/Linux standalone on armv5tel: error: "git-annex died of signal 4" bugs/Make Setup.hs work for cabal new-build bugs/Makefile should use $(GHC) to run ghc --make bugs/Massive git add produces sqlite crashes bugs/Metadata views in v6 repo upgraded from direct mode act strangely bugs/Missing automounts block every command bugs/Missing backend extension in files with long extensions bugs/Missing sanity check of group names. Special group names should not be allowed. bugs/More build oddities under OpenBSD bugs/Move out of shared repository as "maintenance user" gives permission denied for files edited by others bugs/No MonadFail instance bugs/OSX: addurl --batch --json spits out shortened output string dies off with 4 bugs/Old dependencies are causing pain with NixOS 18.09 bugs/Operating system should be contained in `git annex version` output regardless if in annex repo or not bugs/Out of memory error when adding large files to v6 repository bugs/Permission problem in second user account on Android bugs/Regression in `find --json` output bugs/Remote does not work with UTF-8 filenames bugs/SMB: git annex clone works, get fails on transfer lock bugs/Set some reasonable requirements lower-bound for linux standalone builds: no longer usable on CentOS 6.5 bugs/Syncing of file contents seems to be broken in recent versions of the assistant bugs/Termux:Boot instructions need a bit of clarity bugs/The S3 special remote limits HTTPS support to port 443 bugs/Three tests fail when annex.backends is defined bugs/Too difficult if not impossible to explicitly add/keep file under git (not annex) in v6 without employing .gitattributes bugs/Unable to get/addurl to http link: download failed: InvalidHeader "preload" bugs/Unable to take transfer lock bugs/Unchanged files are detected as modified in unlocked branch bugs/Upload to box very slow bugs/Uses rsync instead of `cp --reflink=auto` on volumes of the same BTRFS partition bugs/Windows to Linux clone - Windows drive letters cause git annex get to fail bugs/add -J fails with not found bugs/add fails with v6 repo when four levels deep bugs/added branches makes 'git annex unused' slow bugs/adding remote server using ssh on a 4.1 device bugs/adds file destined for annex into git in 'addurl' bugs/addurl --batch --with-files doesn't add file into git until pipe is closed bugs/addurl --batch (--json or not) doesn't report failure correctly if non-annexed file exists bugs/addurl --batch decides to talk to ssh remotes for some reason bugs/addurl --file causes file redownload even if it already present bugs/addurl fails with non-youtube url with "This url is supported by youtube-dl, but youtube-dl could potentially access any address" bugs/addurl results in different file to wget bugs/addurl youtube-dl behavior change bugs/after git annex add and commit, git annex fsck fails: no known copies bugs/android 4.3 install failed bugs/android ed25519 algorithm bugs/android installation fails bugs/android: cannot link executable bugs/annex copy might not report percent-progress when it has actual key file bugs/annex drop fails to determine availability on a http url redirecting to ftp bugs/annex drop is not "in effect" for load which was "addurl --batch"ed but not yet committed bugs/annex get -J 16 via ssh stalls bugs/annex ignores pushurl and uses only url upon "copy --to" bugs/annex init no longer generates default description bugs/annex is not satisfied by full and correct full download bugs/annex sets remote (regular http) to be ignored while running in docker container bugs/annex sync (in direct mode only) does not actually update local branch/tree bugs/annex unannex/uninit should handle copies bugs/annex view barfs fatal: Unable to add (null) to database bugs/annex-checkuuid renders remotes inaccessible bugs/annex-lookupkey fails to deal with absolute paths bugs/annex.autocommit seems ignored for new files bugs/assistant crashes in TransferScanner/comment 11 6a5fe92c433ca7b6e66bbb86a16aa3b1 bugs/assistant does not always use repo cost info when queueing downloads bugs/assistant doesn't sync empty directories bugs/assistant doesn't sync file permissions bugs/assistant ignores foreground switch bugs/assistant should set up dedicated ssh keys for remotes using the standalone tarball bugs/assistant sometimes does not merge changes from remote bugs/automatically adding metadata fails on files with UTF-8 umlauts bugs/aws 0.16 breaking changes bugs/bash: git-annex-shell: command not found bugs/btshowmetainfo required although built with torrentparser bugs/can't get bugs/can't launch assistant on latest OSX build bugs/cannot "install" standalone git annex within afs mount bugs/cannot remove `.t` directory bugs/cannot talk with nextcloud server bugs/cause: fake annex repo | result: inflated numcopies | workaround: initialize properly bugs/checkpresentkey batch stops at 97 or 98 keys bugs/clash of -j in copy for --json --json-progress bugs/committing files into git doesn't work with explicitly given paths in V6 bugs/concurrent git-annex processes can lead to locking issues bugs/configuration options for system ssh and bundled ssh are incompatible bugs/could standalone copy of git ship/deploy hooks samples as well as stock git? bugs/crippled filesystem direct mode sync loop bugs/crypto-api is a global dependency because of Utility.AuthToken bugs/dashed ssh hostname security hole bugs/data loss from dedup when v7 unlocked file is duplicated/truncated bugs/direct command leaves repository inconsistent if interrupted bugs/direct mode fails, left in an inconsistent state bugs/direct mode merge interrupt bugs/direct mode should refuse to merge with illegal filenames bugs/direct mode to v7 upgrade bug bugs/direct mode upgrade with deleted file bugs/does not build on OpenBSD 5.9 bugs/does not handle youtube playlists bugs/downloads.kitenet.net/git-annex/OSX/current/ distribution is 7.20190508 but 7.20190615 expected bugs/dropkey --batch --json --force is always succesfull bugs/dropunused does nothing bugs/duplicate progress reports in parallel 'get' bugs/easy feature request: enable lan sync on android bugs/exporttree interaction with adjusted branch bugs/external remote hGetContents handle error bugs/external special remote protocol broken by key with spaces bugs/fails to init under a directory with a "tricky" name bugs/fails to verify presence via http while wget fetches it just fine bugs/false positives from fsck in bare repo bugs/fatal: git-write-tree: error building trees bugs/fatal: unable to normalize object directory bugs/feed dependency bugs/find with batch does not apply matching options bugs/fingertree >= 0.1.2 causes build to fail on reducers bugs/fresh build for neurodebian: test failure bugs/g-a move has force option described twice bugs/get --json fails whenever plain get works (with https urls) bugs/get -J "fails" to get files with the same key bugs/get -J from ssh remote tries to lock in home directory? bugs/get -JX: transfer already in progress ... for some files bugs/get fails to place v7 unlocked file content into the file tree in v7 in repo with detached HEAD bugs/get from exporttree remote sometimes fails bugs/get from the web remote fails (redirect?) - lack of further debug info bugs/get over ssh fails with fd:19: hClose: resource vanished bugs/git annex $command --help not recoginized bugs/git annex adjust --unlock seems to cause migration of a file to another backend bugs/git annex enableremote ignoring encryption changes bugs/git annex forget --drop-dead can lose group information bugs/git annex fsck --from web removes all urls of a file bugs/git annex help options not piped through PAGER bugs/git annex import fails on filenames with newlines in them bugs/git annex status fails with submodule in direct mode bugs/git annex still deleting content when merging bugs/git annex sync in direct mode does not honor skip-worktree bugs/git annex test fails bugs/git annex testremote fails on OSX because native 'mktemp -d' doesn't work bugs/git-annex 6.20161031 fails with filenames containing newlines bugs/git-annex adds unicode characters at end of checksum bugs/git-annex addurl & CDN: curl does not follow bugs/git-annex can no longer copy files to box bugs/git-annex can't compile on FreeBSD bugs/git-annex can't compile on FreeBSD using stack bugs/git-annex can't find gpg if it's named gpg2 bugs/git-annex does not build with aws 0.16 bugs/git-annex doesn't find adb device bugs/git-annex in nixpkgs fails with git-2.13.0 bugs/git-annex requires an SSH remote to have an absolute path bugs/git-annex stack.yml misses extra-deps. bugs/git-annex standalone provides gpg but not gpg-agent bugs/git-annex upgrade fails bugs/git-annex: <socket: 16>: hPutBuf: resource vanished (Broken pipe) bugs/git-annex: unable to decommit memory: Invalid argument bugs/git-annex-drop docs and git-annex-requires bugs/git-annex-export treeish subdir path does not exist[[done]] bugs/git-annex-init with no args overwrites existing repo description bugs/git-annex-migrate fails bugs/git-clone --single-branch confuses git-annex-init and git-annex-sync bugs/gitweb link is wrong on download page bugs/glacier bugs/googlemail bugs/graft/graft cleanup commits -- really needed? bugs/http git remote uuid discovery repeated bugs/i386ancient tarball git too old error bugs/if annex.genmetadata is true, modification metadata is imported from older file versions after unlock+add bugs/import --force does not operate on locked files bugs/import tree should skip .git bugs/importfeed "parsing the feed failed" without further info bugs/importfeed bad request without User-Agent: bugs/importfeed does not work with socks proxy bugs/importtree not supported in adb remote bugs/impossible to login to the website at times bugs/inAnnex check failed repeatedly for present content v6 bugs/inconsistent output upon addurl --batch complicates if not forbids reliable parsing of output bugs/indeterminite preferred content state for duplicated file bugs/info --json lists backend usage stats as a list of lists bugs/initial get -J on exported S3 bucket fails bugs/install-completions target has missing dependency bugs/interoperability issue between buster and stretch bugs/issue with syncing between v5 and v6 repos bugs/jobs bugs/json should be utf8 regardless of locale bugs/lineageOS android install fail: incorrect arch test bugs/linux standalone git annex won't work in a directory whose path contains : or ; bugs/lookupkey started to spit out "debug" messages to stdout bugs/man page for command misses actual command in the synopsis for git-annex-checkpresentkey bugs/manages to incorrectly add to annex instead of git based on "mimetype" - we cannot figure it out why bugs/migrating to non-E backend still adds extensions bugs/minor display glitch with ssh password prompting and -J bugs/move violates numcopies bugs/multiple ssh prompts, and thread blocked indefinitely in an ??? transaction bugs/new git-annex-shell protocol hides remote error messages bugs/new whereis --json lost information about web urls if other special remotes provide them bugs/no prebuilt package for intel 64 architecture bugs/no progress display for transfer to or from export remote bugs/occasional hang with p2pstdio bugs/parallel get can fail some downloads and require re-getting bugs/post-receive bugs/potential data loss after late enabling of S3 versioning bugs/prematurely (can't check offline) marks remote as annex-ignore bugs/problem commit normal links bugs/problems with android and gpg bugs/regression - fails to drop . Exit code 11 wo --debug, and 1 with --debug bugs/regression - yt: prefix for "regular" urls bugs/regression: fails to detect need for pidlock on an NSF mount bugs/regression: http downloads redirecting to ftp are no longer supported bugs/remote repository must be version 6 as well to have copied files appear correctly bugs/remote tracking exporttree importtree directory bugs/repeated import of same content files from remote bugs/reports success when addurl --batch a file which is .gitignore'd bugs/rsync and gcrypt special remotes make -J slow bugs/rsync fails with sync error: syntax or usage error bugs/same uuid for remotes with same path but different name bugs/security hole private data exposure via addurl bugs/signal weirdness bugs/standalone debian pkg build fails in sid bugs/strips _ from extensions in E backends? bugs/suggests to enable web remote even when there is no web urls for the file bugs/support bare git repo, with the annex directory exposed to http bugs/sync does not drop local content present in exporttree remote bugs/sync with clone protocol error bugs/test suite fails on windows bugs/the assistant fail to correctly add or sync ssh remote with non ascii letter in the directory bugs/thread blocked indefinitely in an STM transaction while moving within a local clone bugs/tor setup needs a unique magic-wormhole appid bugs/treatment of largefiles is not working for addurl --fast (or --relaxed) bugs/unRAID shares treated as a crippled filesystem bugs/unclear why annex fails to get a file from a public S3 bucket where it exported before bugs/upgrade to version 7 not going well, bup remote missing its uuid bugs/using regular magic file warning pollutes stderr bugs/v6 - under subdir: git add "whines", git commit "blows" bugs/v6 hardlinking is not stable across lock/unlock or cloning bugs/v6 smudge filter breaks git diff for files outside the repository bugs/v6 unlock confused by touch bugs/v6: git status/add after unlock is linear to the file size bugs/v6: write permission on annex object if unlocked, modified, and readded bugs/v7 fails to fetch files on FAT filesystem bugs/v7 unlock big file: out of memory bugs/versioned S3 generates invalid encoded url bugs/webdav remote fails on pound signs bugs/windows annex link wrong bugs/windows export tree exports empty tree bugs/windows fails import export tests bugs/windows support totally bitrotted bugs/windows test suite fails to init direct mode repo bugs/windows: autostart for annex 64bit looks under x86 bugs/withOtherTmp file escapes bugs/wrong permissions of unused, badunused and tmpunused? bugs/yesod-default appears no longer necessary bugs/zsh completions installed to location not in fpath design/assistant design/assistant/blog/day 288 success stories/comment 12 f2df427cf3608377e9a52d8bdeadb26f design/assistant/blog/day 288 success stories/comment 18 9a57de4cea407a73b2d023d85afdccc6 design/assistant/blog/day 288 success stories/comment 5 7ca419aa3a187857b19268572d5df297 design/assistant/blog/day 288 success stories/comment 7 146331ae2de25a6dc3595dffab9514de design/assistant/polls/goals for April design/assistant/xmpp security design/new repo versions forum/How to retroactively annex a file already in a git repo forum/Out of memory error in fsck, whereis, find and status cmds forum/autobuilders for git-annex to aid development forum/batch check on remote when using copy forum/cloud services to support forum/example of massively disconnected operation forum/git-annex communication channels forum/hashing objects directories forum/lets discuss git add behavior forum/new linux arm tarball build forum/new microfeatures forum/performance improvement: git on ssd, annex on spindle disk forum/tips: special_remotes/hook with tahoe-lafs/comment 6 2e9da5a919bbbc27b32de3b243867d4f forum/working without git-annex commits install/Linux standalone news/git annex fall of code news/sharebox a FUSE filesystem for git-annex special remotes/hook testimonials thanks tips/assume-unstaged tips/finding duplicate files tips/install on Android in Termux/old comments tips/setup a public repository on a web site tips/using Google Cloud Storage tips/what to do when a repository is corrupted todo/'info filename' to provide information either content is locally present todo/--batch for add todo/--batch for copy todo/--batch for find todo/--batch for info todo/Add a way to mark exporttree remotes dead todo/Add confirmation dialog to the restart option todo/Allow for TRANSFER-SUCCESS to report also a URL where key could now be obtained from todo/Amazon Cloud Drive todo/Avoid repo fixup if ".noannex" is present todo/Bittorrent-like features todo/Compatibility with socks-0.6 and persistant-template-2.7 todo/Display the version of a library corresponding to a build flag todo/Error when using 6.20180913 with 6.20170101-1+deb9u2 todo/Exporting with exporttree should sync files deleted from the remote todo/Facilitate public pretty S3 URLs todo/Finding content in other repositories should not need a git remote todo/INFO message for custom special remotes todo/LFS API support todo/Make default annex version match (clone or sync) parent todo/Not working on Android-x86 todo/PATCH: drop url parameters from extension.hs todo/Retire Esqueleto as a dependency todo/S3 anonymous exporttree support todo/S3 fsck support todo/Slow transfer for a lot of small files todo/Support for include matching option in findref todo/Test cases for exporttree special remotes todo/adb import todo/adb special remote todo/add --json-progress to `git annex add` todo/add option to whereis to avoid network interactions todo/add prefix option to export todo/add sftp special remote todo/addurl improvements todo/addurl should fail when youtube-dl disabled todo/allow disk space quota independent of free disk space todo/amazon prime photos todo/annex.addunlocked in gitattributes todo/annex.thin without hardlinks todo/append-only mode todo/arm64 autobuilder todo/assistant cannot set up remote repo via an ssh alias or an ip address todo/batch command result status todo/be able to refer to remotes by uuid todo/be able to specify custom commit message for git-annex branch commit todo/better error messages for local remote todo/better exceptions to annex.security.allow-unverified-downloads todo/borg special remote todo/cache key info todo/checkpresentkey without explicit remote todo/checksum verification on transfer todo/cloning direct mode repo over http todo/config option to use all processors by default todo/configuration option for default "mode" on crippled file systems todo/could standalone 'fixed' git-annex binaries be prelinked? todo/custom f-droid repo todo/delete old misctmp files todo/do not allow using stop in CommandPerform todo/do not block on crypto key generation todo/drop --batch todo/dumb, unsafe, human-readable backend todo/easy way to reproduce normal download command todo/export todo/export preferred content todo/feature request: pubkey-only encryption mode todo/find unlocked files todo/get --batch todo/git annex info <remote> does not list all the parameters for the remote todo/git annex info to include information about repo version? todo/git smudge clean interface suboptiomal todo/git-annex 7.20181105 not buildable against Debian stretch todo/git-annex 7.20181121 not buildable against Debian stretch todo/git-annex ignores GIT_SSH todo/git-annex-fromkey behavior when target file exists todo/git-hook to sanity-check git-annex branch pushes todo/hidden files todo/hide missing files todo/import --reinject todo/import from special remote large git log todo/import tree from rsync special remote todo/improve gcrypt remote todo/improve memory usage of --all todo/include msg with possible reason why command (e.g. add) failed into --json output todo/inneficiency on slow filesystems opening nonexistant journal files todo/integrate support for spideroak as archive/backup todo/interface to the "progress" of annex operations todo/learn about remotes that are currently unavailable todo/limit to low cost remotes todo/lockdown hooks todo/make addurl respect annex.largefiles option todo/make copy --fast faster todo/metadata --batch todo/more efficient memory usage with git-annex unused todo/more efficient resolution of trivial export conflicts todo/more of diagnostic information in case of failures into returned json todo/multicast "broadcasting" of content on local net todo/need to remove remoteGitConfig for checkuuid support todo/network test suite todo/only allow one git queue to be flushed at a time todo/option in git-annex-export to include git files todo/option to avoid slow transfers todo/output of wanted (and possibly group etc) should not be polluted with "informational" messages todo/parallel get todo/per-remote metadata needs to be cleaned in dropdead todo/prevent directly printing to stderr error from an attempt to download remote /config file todo/prevent unwanted init todo/provide 'file' in --json-progress record for addurl todo/redundancy stats in status todo/renameremote todo/required content todo/return "key" entry in --json output for addurl (and future add) --batch todo/sha1 collision embedding in git-annex keys todo/simpler setup for remote worktree update on push todo/smudge todo/speed up transfers over ssh+rsync -- directly reuse the same connection? todo/ssh special remote todo/stop using createDirectoryIfMissing True todo/stop using curl and wget todo/stream feature? todo/support ~/.netrc for http access authentication specs as was done when wget was used todo/support .netrc for fsck --from web todo/support disabling verification of transfer over p2p protocol todo/support longer file extensions todo/support public versioned S3 access todo/switch from quvi to youtube-dl todo/symlinks for not-present unlocked files todo/sync content of a single directory or file todo/sync to non tracking export confusing todo/tahoe lfs for reals todo/termux package todo/test suite failures since 7.20181121 todo/testremote for read-only remotes todo/to and from multiple remotes todo/transfer between git-annexes todo/unable to add files to a git-annex repo in Windows todo/unify adjust with view todo/unlock --json todo/unused file tracking recommendation changed since v7 todo/upload large chunks without buffering in memory todo/use git-mktree rather than index file todo/v7 InodeCache timestamp resolution todo/versioning in export remotes todo/way to untrust without unncessary branch update todo/webapp export remote configuration interface todo/webapp ssh setup should work with locked down git-annex-shell account todo/windows support todo/wishlist: an "assistant" for web-browsing -- tracking the sources of the downloads todo/wishlist: disable automatic commits todo/wishlist: do not import new files todo/wishlist: make partial files available during transfer todo/wishlist: pack metadata in direct mode todo/wishlist: per-repository autocommit=false todo/wishlist: provide a config option for using new hashing scheme in non-bare remotes todo/wishlist: rsync efficiency todo/wishlist: spec.remotes for other peer network data stores (gnunet, freenet) todo/wishlist: special remote Ubuntu One

Last edited Wed Jan 21 18:58:21 2015