shadowmoose
Serious problems with Youtube-DL
Describe the bug
Whenever i try to download any users or subreddit, both with and without pushshift I'll always end up stuck with the Ytdl handler showing "Status: Looking for video..." or "Status: Downloading video... (100.0%)". I have no error showing up but when you run the downloader more than 14 hours and are still stuck at 61 of 1520 files completed with the same files active in the threads there must be something wrong.
Environment Info
- OS: Windows 10 Home
- RMD Version: 3.1.5
Hey thanks for the report. Can you provide which post or URL is being downloaded when it hangs?
Well i have been playing around with the software and usually i try to download subreddits. Can't pinpoint the exact URL where it hangs but it is always related to video and the Ytdl-handler. When i start to download it proceed as long as it's only pictures. Then video enters the room and all the 5 concurrent downloading threads i have fills up and halt the process while the queue grows. It also appears as if it some times miraculous can pull through and complete the video but when it hangs it can take 20 minutes to 3 hours to do so. And you would think it's because of large files but they're only 3-10mb.
I use these settings:
Source Type: pushshift-submission-source Subreddit: anyRandomSubRedditWithSomeVideos limit: 0 time: All Time sort by: created_utc sort by order: Descending
I have tried to complete a run about 8 times but never had any success because of total breakdowns. The best achievement is 150k files completed in a 5 days run but that also had the de-duplication crashed.
Hmm, best bet is that YTDL is having issues with whatever it's downloading. It may also be throttling, depending on the site. I'll look into preventing this.