goci
goci copied to clipboard
EBISPOT
testing importing large publication with >30000 studies failed
Testing PMID: 34375979
Was successfully submitted in the testing environment (without sumstat): https://wwwdev.ebi.ac.uk/gwas/depo-curation/submissions/62e27657fd97600001675cec
but after it is imported in the testing environment, the page is not loading gwas-snoopy.ebi.ac.uk:9780/gwas/curation/submissions/62e27657fd97600001675cec.
No. of studies 30445 No.of associations: 50450
This is a user-submitted study: https://www.ebi.ac.uk/gwas/depo-curation/submissions/62c592398a6cfa0001651079
@Santhi1901 @ljwh2 based on my investigation the Submission page is not loading due to huge Payload of the AZ submission , the API being called by Curation for loading submission is not paginated so it hangs trying to process huge payload, We need to create a Dev story in order to introduce Pagination in API then only the AZ submission can be curated .
Dependent on the implementation of the new features here:
https://app.zenhub.com/workspaces/gwas-59df823c4a6feb3786810391/issues/ebispot/gwasdepo-ingest-service/37
https://app.zenhub.com/workspaces/gwas-59df823c4a6feb3786810391/issues/ebispot/goci/847
The submission status after importing shows 'CURATION COMPLETE' (http://gwas-snoopy.ebi.ac.uk:9780/gwas/curation/submissions/62e27657fd97600001675cec), but the imported studies are not seen in the curation app http://gwas-snoopy.ebi.ac.uk:9780/gwas/curation/publication/34375979
Just noting here I confirmed with @jdhayhurst the sumstats submission part is complete, sumstats are on staging already and no further work should be needed on the sumstats service to get the studies published: https://www.ebi.ac.uk/gwas/deposition/submission/62c592398a6cfa0001651079
The changes have been deployed in Prod as part of Scaling issue fix for Depo Sync , we will optimize further for AZ submission , identified few improvement areas
@Santhi1901 tested re-import, still running after several days so likely this has failed