database download arrested even on 13Mbps speed

[Rohit-Satyam]

Hi Developers!!

We have wonderful download speed yet our download get stalled at this step. Is there a way to resume download? Is there a link to download this database otherwise.

Resolving ftp.ncbi.nlm.nih.gov (ftp.ncbi.nlm.nih.gov)... 165.112.9.230, 130.14.250.10, 2607:f220:41f:250::229, ...
Connecting to ftp.ncbi.nlm.nih.gov (ftp.ncbi.nlm.nih.gov)|165.112.9.230|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done.    ==> PWD ... done.
==> TYPE I ... done.  ==> CWD (1) /blast/db/FASTA ... done.
==> SIZE nr.gz ... 137831954826
==> PASV ... done.    ==> RETR nr.gz ... done.
Length: 137831954826 (128G) (unauthoritative)

nr.gz                                                  0%[                                                                                                                      ] 313.64M  --.-KB/s    in 35m 30s

2022-06-04 12:35:47 (151 KB/s) - Data connection: Connection timed out;

[fpusan]

Sure, try download_databases.pl instead!

[fpusan]

Just as an update to this, as this happened to me too last week...

This issue happens when using make_databases.pl and downloading the nr database from NCBI's site. In my experience this download will sometimes fail midway (or not even start, depending on how their servers are feeling, or your proxy configuration). Restarting the command sometimes work.

Note that this is completely outside of our control. The file is hosted by NCBI and we can do nothing about the responsiveness of their servers. We provide a second comand names download_databases.pl, which will download a precompiled database from our own servers. These servers are overworked and will also sometimes fail (we would ideally host the data somewhere like Amazon, but it becomes very expensive when people are downloading several hundreds of Gb a day). This said, our servers work generally fine, and we can at least try to fix things when they are not.