If running the clean/smudge filter once per file is a bottleneck, might it speed things up to split them off into something more lightweight than the full git-annex binary?