Please describe the problem.
Any file containing non ascii chars either won't get commited by the webapp or when clone of that repo is made they are shown as deleted in git status but the files are there.
you can not commit them neither,
git commit -m 'foo'
or
git annex sync
will get them to commit trying to reset the state using,
git checkout master
or
git clean -f
won't fix the issue. till the issue is fixed sync does not work from the command line since there are changes. Temporarily running assistant in the directory does fix the problem but every now and then it pops again.
Also moving any symlinks around containing non ascii chars also causes the same issue. git annex won't add the moved symlinks git annex fix or git annex add won't add them git annex sync also skips them again the only solution is to either run the assistant or restart it if it is running.
What steps will reproduce the problem?
Adding any file with a non ascii char on OS X (10.9).
What version of git-annex are you using? On what operating system?
git-annex version: 5.20140421-gc34a665
Please provide any additional information below.
Also another thing I noticed is that same file names same repo will clone fine on Linux no errors this only happens on OS X.
# If you can, paste a complete transcript of the problem occurring here.
# If the problem is with the git-annex assistant, paste in .git/annex/daemon.log
# End of transcript or log.
I think you are going to need to provide more information:
I tried with some unicode filenames on OSX and they were committed without difficulty in the en_US.utf8 locale.
I file name I remember messing is the following,
I experience this problem with any char that is not ascii. As for my locale,
LANG="en_US.UTF-8" LC_COLLATE="en_US.UTF-8" LC_CTYPE="en_US.UTF-8" LC_MESSAGES="en_US.UTF-8" LC_MONETARY="en_US.UTF-8" LC_NUMERIC="en_US.UTF-8" LC_TIME="en_US.UTF-8" LC_ALL="en_US.UTF-8"
There no errors other than the behaviour I've described.
I tried with that filename, and had no difficulty committing it.
oberon:repo joeyh$ git annex add George\'s\ Cafe\314\201 add George's Café ok (Recording state in git...) oberon:repo joeyh$ git commit -m foo [master (root-commit) 8acd5d4] foo Committer: Joey Hess Your name and email address were configured automatically based on your username and hostname. Please check that they are accurate. You can suppress this message by setting them explicitly: git config --global user.name "Your Name" git config --global user.email you@example.com After doing this, you may fix the identity used for this commit with: git commit --amend --reset-author 1 file changed, 1 insertion(+) create mode 120000 "George's Caf\303\251"I even tried running the assistant with all locale settings set to C, and it still had no problem adding and committing that filename.
So, I need help reproducing this, or I need to see the error message you see when the problem happens to you.
@joeyh.name: did you notice the subtle difference between the filename in the input and the output in your example? I think it might cause problems due to a discrepancy between
git annexand the file system when checking if a file exists or not. Not sure if the problem is ingitorgit annex; what do you think?See Unicode Subtleties in the HFS Plus Volume Format and
git configforcore.precomposeUnicodeHere's a
printfexample.