openneuro icon indicating copy to clipboard operation
openneuro copied to clipboard

fetching and pushing through git

Open yarikoptic opened this issue 8 months ago • 4 comments

We have datalad dataset which we had curated for awhile and now decided to push to openneuro including our (partially squashed) git history. Major differences from the "templated" by openneuro dataset is use of MD5E backend, having our own datalad dataset uuid, and having custom .gitattributes file already. Nothing of that should effect git fetch though.

(deno) yoh@typhon:/mnt/DATA/data/yoh/1076_spacetop$ git fetch -v  openneuro-git
POST git-upload-pack (1022 bytes)
POST git-upload-pack (1022 bytes)
POST git-upload-pack (gzip 1822 to 983 bytes)
fatal: the remote end hung up unexpectedly

After I cloned into a separate directory and merged (allowing unrelated histories) the main branch into our master and tried to push, got following crash

(deno) yoh@typhon:/mnt/DATA/data/yoh/1076_spacetop$ git push openneuro-git master:main
Enumerating objects: 49049, done.
Counting objects: 100% (49049/49049), done.
Delta compression using up to 32 threads
Compressing objects: 100% (37989/37989), done.
error: RPC failed; HTTP 502 curl 22 The requested URL returned error: 502
send-pack: unexpected disconnect while reading sideband packet
Writing objects: 100% (49044/49044), 118.04 MiB | 3.75 MiB/s, done.
Total 49044 (delta 11011), reused 48763 (delta 10932), pack-reused 0
fatal: the remote end hung up unexpectedly
Everything up-to-date

and now after we did get all the objects through local

(deno) yoh@typhon:/mnt/DATA/data/yoh/1076_spacetop$ git fetch openneuro-git
From https://openneuro.org/git/0/ds005256
 * [new branch]            git-annex  -> openneuro-git/git-annex
 * [new branch]            main       -> openneuro-git/main

attn @jungheejung

yarikoptic avatar Jun 22 '24 03:06 yarikoptic