Do depo-sync manually & increase time limit for ftp-sync

[karatugo]

🔴 Decrease ftp-sync time limit to 4h 🔴 Decrease depo-sync time limit to 2h (*2 times/day)

[karatugo]

• [x] There are 9757 files at the moment. Check back again how many of them are processed. (Update: there are 8708 files)
• [x] Also make sure that all processed files from staging end up in the public ftp.

[karatugo]

Submitted a 10-hour SLURM job using the script /hps/software/users/parkinso/spot/gwas/prod/scripts/cron/sync_from_depo_slurm_manual.sh.

         JOBID PARTITION NAME                                                    USER     ST TIME       NODES  NODELIST
       5529965 datamover sumstats_sync_manual                                    spotbot  R  3:54       1      codon-dm-08

[karatugo]

In the future, we might consider doing depo-sync at midday and ftp-sync at midnight.

[karatugo]

There are about ~1000 files left to sync. Submitted another SLURM job.

         JOBID PARTITION NAME                                                    USER     ST TIME       NODES  NODELIST
       5983210 datamover sumstats_sync_manual                                    spotbot  R  0:43       1      codon-dm-06

[karatugo]

Manual sync complete. All studies are now synced to the staging ftp.

[karatugo]

Increased ftp-sync time limit to 12h temporarily. Will decrease next week again.