goci icon indicating copy to clipboard operation
goci copied to clipboard

Reharmonise updated sumstats for GCST90268462 to GCST90268500

Open eks-ebi opened this issue 1 year ago • 10 comments

GCST90268462 - GCST90268500 have been updated manually (replaced on staging).

New harmonised files need to be generated for these studies.

eks-ebi avatar Mar 04 '24 16:03 eks-ebi

They are not harmonised yet either. Can be closed.

karatugo avatar Mar 13 '24 14:03 karatugo

@karatugo Just to make sure I understand: I recently manually replaced the summary statistics for these studies with corrected versions supplied by the author. The old summary statistics files had already been harmonised, so I deleted the old harmonised versions. I would now like new harmonised files to be created for the new summary statistics that I have added.

Are you saying that we can just wait, and this task will be picked up automatically by the harmonisation pipeline?

eks-ebi avatar Mar 14 '24 09:03 eks-ebi

@eks-ebi Sorry for the misunderstanding. I didn't realize the old harmonised files were deleted. I thought they hadn't been created yet. In that case, they would automatically enter the harmonisation pipeline. But, since they were already generated and then deleted, we need to reharmonise them. I'll take care of it.

karatugo avatar Mar 15 '24 11:03 karatugo

thanks @karatugo!

eks-ebi avatar Mar 15 '24 12:03 eks-ebi

Submitted to codon-slurm.

         JOBID PARTITION     NAME     USER ST       TIME  NODES NODELIST(REASON)
      62990405  standard goci1258 gwas_lsf  R       3:30      1 hl-codon-10-03

karatugo avatar Mar 15 '24 16:03 karatugo

The job in SLURM failed, submitted using LSF.

92613079   gwas_ls RUN   standard   codon-login hl-codon-44 *sf.config Mar 18 12:49

karatugo avatar Mar 18 '24 12:03 karatugo

LSF job is likely to fail, do first https://github.com/EBISPOT/goci/issues/1257

karatugo avatar Mar 20 '24 10:03 karatugo

https://github.com/EBISPOT/goci/issues/1257 done.

Submitted a SLURM job now.

         JOBID PARTITION     NAME     USER ST       TIME  NODES NODELIST(REASON)
        383374  standard goci1258  spotbot  R       0:13      1 hl-codon-10-01

karatugo avatar Apr 10 '24 10:04 karatugo

still running...

karatugo avatar Apr 12 '24 10:04 karatugo

I have contacted Yue for assistance in debugging the issue, as similar failures are occurring frequently.

[1a/b4a5a3] process > NFCORE_GWASCATALOGHARM:GWAS... [100%] 39 of 39, failed: 39

karatugo avatar Apr 15 '24 10:04 karatugo

  • [x] Copy harmonised files from /nfs/ftp/private/gwas_cat/harm_test/success/GCST90268001-GCST90269000/ to the public ftp.

karatugo avatar Apr 24 '24 12:04 karatugo

@eks-ebi Please confirm that the files are indeed on the public FTP.

karatugo avatar Apr 24 '24 16:04 karatugo

@karatugo Yes this is done! sorry for the delay

eks-ebi avatar May 01 '24 09:05 eks-ebi