swallowed critical note from git-annex: transfer already in progress, or unable to take transfer lock

[yarikoptic]

@Shotgunosine reported (any further detail, like datalad/git-annex version could be valuable) on public riot room. Was trying to figure what is going on with erroring out pushes:

(/gpfs/gsfs11/users/MBDU/midla/env) [nielsond@helix sub-01]$ datalad push --to gin *taskVsBaseline*.nii.gz
Transfer data to 'gin':  50%|█████████████████████████████████████████████████▌                                                 | 2.00/4.00 [00:00<00:00, 6.57k Steps/s
CommandError: 'git -c diff.ignoreSubmodules=none annex copy --batch -z --to gin --fast --json --json-error-messages --json-progress -c annex.dotfiles=true -c 'remote.gin.annex-ssh-options=-o ControlMaster=auto -S /home/nielsond/.cache/datalad/sockets/0c1f8029' -c annex.retry=3' failed with exitcode 1 under /gpfs/gsfs11/users/MBDU/nielsond/dccc2019/try_gnode/fitlins_tests
git-annex: copy: 4 failed

and it took a direct git annex copy to see

(/gpfs/gsfs11/users/MBDU/midla/env) [nielsond@helix sub-01]$ git annex copy --to gin *taskVsBaseline*.nii.gz
copy sub-01_task-rhymejudgment_space-MNI152NLin2009cAsym_contrast-taskVsBaseline_stat-effect_statmap.nii.gz (to gin...) (transfer already in progress, or unable to take transfer lock) failed
copy sub-01_task-rhymejudgment_space-MNI152NLin2009cAsym_contrast-taskVsBaseline_stat-FEMA_statmap.nii.gz (to gin...) (transfer already in progress, or unable to take transfer lock) failed

which seems to used to be (looking at https://github.com/datalad/datalad/issues/2768) channeled to the user in message of the results rendering at least for get. Also I see it in PROGRESS-JSON logs of https://github.com/datalad/datalad/issues/4779#issue-667945500 but I guess it was not a "stock" datalad (we do not show PROGRESS-JSON log entries AFAIK)

[Shotgunosine]

Thanks for posting the bug @yarikoptic! Her's the datalad and git annex versions:

(/gpfs/gsfs11/users/MBDU/midla/env) [nielsond@helix fitlins_tests]$ datalad --version
datalad 0.14.2

(/gpfs/gsfs11/users/MBDU/midla/env) [nielsond@helix fitlins_tests]$ git-annex version
git-annex version: 8.20201007-g903b2f1
build flags: Assistant Webapp Pairing Inotify DBus DesktopNotify TorrentParser MagicMime Feeds Testsuite S3 WebDAV
dependency versions: aws-0.22 bloomfilter-2.0.1.0 cryptonite-0.26 DAV-1.3.4 feed-1.3.0.1 ghc-8.8.4 http-client-0.6.4.1 persistent-sqlite-2.10.6.2 torrent-10000.1.1 uuid-1.3.13 yesod-1.6.1.0
key/value backends: SHA256E SHA256 SHA512E SHA512 SHA224E SHA224 SHA384E SHA384 SHA3_256E SHA3_256 SHA3_512E SHA3_512 SHA3_224E SHA3_224 SHA3_384E SHA3_384 SKEIN256E SKEIN256 SKEIN512E SKEIN512 BLAKE2B256E BLAKE2B256 BLAKE2B512E BLAKE2B512 BLAKE2B160E BLAKE2B160 BLAKE2B224E BLAKE2B224 BLAKE2B384E BLAKE2B384 BLAKE2BP512E BLAKE2BP512 BLAKE2S256E BLAKE2S256 BLAKE2S160E BLAKE2S160 BLAKE2S224E BLAKE2S224 BLAKE2SP256E BLAKE2SP256 BLAKE2SP224E BLAKE2SP224 SHA1E SHA1 MD5E MD5 WORM URL X*
remote types: git gcrypt p2p S3 bup directory rsync web bittorrent webdav adb tahoe glacier ddar git-lfs httpalso hook external
operating system: linux x86_64
supported repository versions: 8
upgrade supported from repository versions: 0 1 2 3 4 5 6 7
local repository version: 8

[just-meng]

Hi all,

Not sure if this is well-placed, but I came across this issue because I got the error below:

For everyone looking for a quick fix, this post solved my problem. Perhaps I didn't kill some previously interrupted transfer properly. So rm -rf .git/annex/transfer/* did the magic.