goci icon indicating copy to clipboard operation
goci copied to clipboard

Duplicate files being create on ftp during data relese

Open ljwh2 opened this issue 2 years ago • 3 comments

User Alistair Rust reported that two directories of files are available for the DR 14th Sept. Screenshot 2022-09-26 at 10.54.34.png The same thing seems to have occurred in August, and possibly other times. Screenshot 2022-09-26 at 10.56.25.png

ljwh2 avatar Sep 26 '22 11:09 ljwh2

Comment from @sprintell:

We have recently had issues with sync project. This looks like something caused by the sync project during DR deployment. The sync tool failed once in d last DR, and was re-triggered by Sajo after TSC fixed it, could it have been that for each of those instances, the ftp release was successful resulting in 2 copies. I also noticed that it seems similar things have happened a couple of times in the past Btw 14th - 29th May. 2018 - http://ftp.ebi.ac.uk/pub/databases/gwas/releases/2018/05/ Btw 14th - 29th Aug. 2018 - http://ftp.ebi.ac.uk/pub/databases/gwas/releases/2018/08/

This files should be synced to the ftp once for every data release

ljwh2 avatar Sep 26 '22 12:09 ljwh2

Happened again 16-17 Feb 2023

ljwh2 avatar May 15 '23 11:05 ljwh2