tistore icon indicating copy to clipboard operation
tistore copied to clipboard

Published 20 hours ago • verified publisher icon Kagami

Fix aborted downloads

Open Kagami opened this issue 7 years ago • 7 comments

See https://github.com/Kagami/tistore/issues/4#issuecomment-411875935 Might be caused by high concurrency level and expiration of default aria's download timeout.

Kagami avatar Aug 09 '18 19:08 Kagami

@Lumerica, yea, I've seen few aborted downloads while testing too, but thought it were just dead links and left unattended. But you're right, it might be caused by high concurrency level too.

Can you reproduce issue with concurrency set to 1?

Kagami avatar Aug 09 '18 20:08 Kagami

Thanks, I am now trying with: beautifulmirinae.tistory.com which I had lots of aborted downloads before I will let you know tomorrow, because its going to take some time to download.

there was also a tistory site that took me 2 full days with 16 threads set about 75 aborted downloads.

Lumerica avatar Aug 09 '18 22:08 Lumerica

the download hasnt finished yet after 8 hours looks like it needs another 7 hours. But so far no aborted downloads just that it takes long time.

Lumerica avatar Aug 10 '18 05:08 Lumerica

Any news?

Kagami avatar Aug 11 '18 22:08 Kagami

Oops I thought that concluded the test, but I would say its OK, just that it took 8 hours and would have taken 15 hours for 1 site.

In the 8 hours 5730 files have been downloaded successfully without any aborted downloads.

Lumerica avatar Aug 13 '18 19:08 Lumerica

Nice. I will try to increase timeouts then and check if that helps.

Kagami avatar Aug 13 '18 19:08 Kagami

thank you for your hardwork :)

Lumerica avatar Aug 15 '18 20:08 Lumerica