scampsdataset icon indicating copy to clipboard operation
scampsdataset copied to clipboard

Published 20 hours ago • verified publisher icon danmcduff

Download Issues

Open Jemspeth opened this issue 2 years ago • 3 comments

I'm having trouble downloading the full video dataset. Using either curl or wget I run into the same issues as #1 , where I get an error between 5 and 100 GB into the download: Read error at byte 16184049664/593450450686 (Connection reset by peer). Retrying.

I've restarted the download ~10 times so far with the same results. Is there any way to chunk up the full dataset into smaller files? Allowing reading at specified byte ranges could also help.

Thanks for a cool dataset!

Jemspeth avatar Jul 03 '22 21:07 Jemspeth

i'm facing the same problem. several smaller files would be nice. dl speed from this server is around 500KB/s in the mean. this is literally more drama than fun.

partofthestars avatar Oct 06 '22 07:10 partofthestars

For resume download, I wrote python code. https://github.com/spaceromany/resume_download_for_scamps

spaceromany avatar Jan 04 '23 07:01 spaceromany

Hi, I am also having a hard time downloading the dataset.

The error I'm getting: Read error at byte 116889796608/593450450686 (Connection reset by peer). Giving up. The same location every time I've tried.

Is there a workaround for this? I also think that smaller files would be easier to download.

Thank you so much in advance for your time and help. And thank you for creating the dataset!

cgmorale avatar Jan 09 '24 18:01 cgmorale