goci icon indicating copy to clipboard operation
goci copied to clipboard

Move sumstats files and yamls to the public ftp

Open karatugo opened this issue 10 months ago • 6 comments

✅ One particular submission with more than 6,000 studies only has md5sums in GCST directories on staging and released to public. No sumstats files or yamls have been created. Submitted on 31.03.24. https://www.ebi.ac.uk/gwas/deposition/submission/6608c665db8d9f000198b901 -- ✅ Copy files to staging -- ✅ Check if the files moved to the staging ftp -- ✅ Check if the files moved to the public ftp -- ✅ Generate metadata yaml files

karatugo avatar Apr 26 '24 14:04 karatugo

Started copying files from the private ftp to staging.

ID: 	3670454
Name: 	copy_goci1304

karatugo avatar Apr 26 '24 14:04 karatugo

Copying files from the private ftp to staging complete.

karatugo avatar Apr 29 '24 10:04 karatugo

Study files are synced successfully to the public ftp.

karatugo avatar May 03 '24 14:05 karatugo

Generate metadata yaml files started here. https://github.com/EBISPOT/goci/issues/1292#issuecomment-2093095857

karatugo avatar May 03 '24 14:05 karatugo

Randomly checked a couple of them and the yaml files are in the public ftp.

karatugo avatar May 07 '24 14:05 karatugo

@eks-ebi pls help confirm ...

sprintell avatar May 08 '24 09:05 sprintell

I checked a few and the sumstats and yaml files are there in the public FTP. There is just one weird thing: the filetype field appears to be blank. See examples yaml file here: http://ftp.ebi.ac.uk/pub/databases/gwas/summary_statistics/GCST90384001-GCST90385000/GCST90384080/

eks-ebi avatar May 15 '24 09:05 eks-ebi

I think this is because they are validated manually. I need to update them in the database.

@eks-ebi Do you know what their correct file types are?

karatugo avatar May 15 '24 13:05 karatugo

@karatugo please ignore the last message, I was looking at the wrong submission

eks-ebi avatar May 15 '24 14:05 eks-ebi

file type for all should be GWAS-SSF v1.0

eks-ebi avatar May 15 '24 14:05 eks-ebi

Added the missing file type to https://app.zenhub.com/workspaces/gwas-59df823c4a6feb3786810391/issues/gh/ebispot/goci/1281 and will work on them soon

karatugo avatar May 17 '24 13:05 karatugo

If there's nothing else, is it okay close this ticket? @eks-ebi

karatugo avatar May 17 '24 13:05 karatugo

sorry @karatugo yes I think it's okay to close this ticket

eks-ebi avatar May 21 '24 09:05 eks-ebi