Please describe the problem.
import manages to import something empty (wild idea, didnt check -- might be a aws s3 key ending with / and creating empty named file or folder?) which lead to
$ git annex initremote s3-origin type=S3 importtree=yes encryption=none autoenable=true bucket=aind-benchmark-data fileprefix=mesoscale-anatomy-cell-detection/ public=yes signature=v4 storageclass=STANDARD port=443 signature=anonymous
...
$ git annex import --from s3-origin master
...
update refs/remotes/s3-origin/master fatal: empty filename in tree entry
ok
(recording state in git...)
$ git merge --allow-unrelated-histories s3-origin/master
fatal: empty filename in tree entry
watchout if to reproduce -- it is about 12GB
What steps will reproduce the problem?
What version of git-annex are you using? On what operating system?
(venv-annex) dandi@drogon:/mnt/backup/dandi/aind-benchmark-data/mesoscale-anatomy-cell-detection$ git annex version
git-annex version: 10.20250521-gafbe7e15b0f44ffa4c597dffc73b7cbdc0d06820
build flags: Assistant Webapp Pairing Inotify TorrentParser MagicMime Servant Benchmark Feeds Testsuite S3 WebDAV
dependency versions: aws-0.24.4 bloomfilter-2.0.1.2 crypton-1.0.4 DAV-1.3.4 feed-1.3.2.1 ghc-9.10.1 http-client-0.7.19 persistent-sqlite-2.13.3.0 torrent-10000.1.3 uuid-1.3.16 yesod-1.6.2.1
key/value backends: SHA256E SHA256 SHA512E SHA512 SHA224E SHA224 SHA384E SHA384 SHA3_256E SHA3_256 SHA3_512E SHA3_512 SHA3_224E SHA3_224 SHA3_384E SHA3_384 SKEIN256E SKEIN256 SKEIN512E SKEIN512 BLAKE2B256E BLAKE2B256 BLAKE2B512E BLAKE2B512 BLAKE2B160E BLAKE2B160 BLAKE2B224E BLAKE2B224 BLAKE2B384E BLAKE2B384 BLAKE2BP512E BLAKE2BP512 BLAKE2S256E BLAKE2S256 BLAKE2S160E BLAKE2S160 BLAKE2S224E BLAKE2S224 BLAKE2SP256E BLAKE2SP256 BLAKE2SP224E BLAKE2SP224 SHA1E SHA1 MD5E MD5 WORM URL GITBUNDLE GITMANIFEST VURL X*
remote types: git gcrypt p2p S3 bup directory rsync web bittorrent webdav adb tahoe glacier ddar git-lfs httpalso borg rclone hook external compute mask
operating system: linux x86_64
supported repository versions: 8 9 10
upgrade supported from repository versions: 0 1 2 3 4 5 6 7 8 9 10
local repository version: 10
the version from pypi @mih started to build recently
Your hypothesis is right, it's items in the bucket with names ending in "/".
After fixing git-annex to skip and warn about those, it looks like this:
Note that "models/smartspim_production_models/config.json" is a file in the bucket located "inside" the first path. So this is not a case of an empty directory being somehow stored to a S3 bucket as a file, but of something else. I have not looked at the contents of these objects, as I would likely not understand them anyway.
I couldn't think of a better method than to warn and skip them. Any name mangling would take a name that could be used by some other file. And not warning risks the user being surprised when all the data in the bucket does not get imported.