LiveStreamDVR icon indicating copy to clipboard operation
LiveStreamDVR copied to clipboard

Scheduled/automated clip downloads

Open cr08 opened this issue 1 year ago • 7 comments

Low priority feature request but thought it might be useful for some. But since we already have a manual clip download function, is it possible we can have an automated/scheduled version of this? I don't know if or think the Twitch API's would allow the system to be notified when a clip is created. But an alternative may be a simple timed check? Say every 24h (or user configurable period) go out and pull the list of clips from the channel, compare against what we already have stored and only grab what doesn't already exist? Just spitballing on functionality here.

Side-request: Adding the ability to add the associated chat log for clips? I can't find a way for tcd to do it, but I know TwitchDownloader can and confirmed the functionality exists in the CLI version. One caveat that I have not had a chance to check in the CLI version but I know happens in the GUI version of TD is clips with no chat will just show Failed so may need to have the necessary checks for this.

cr08 avatar Aug 11 '22 01:08 cr08

hooking onto when each clip is created sounds a bit spammy to me, if a channel is just fairly big, you'll be downloading thousands of clips of nothing

MrBrax avatar Aug 11 '22 10:08 MrBrax

made one that would run once a day with some configuration options, not that fleshed out yet

MrBrax avatar Aug 11 '22 11:08 MrBrax

Sorry for the delayed replies, but this is greatly appreciated! Seems to be working well so far. I'm seeing the clips stored, just nothing in the web interface (which honestly I'm perfectly ok with at the moment. No rush from me to flesh the rest of it out. 😄 ).

Thanks all around for the work on this tool. It's been a lifesaver (and literal time saver!) for me. I help manage a few friend's streams and I've been archiving VODs/clips/chats for them but have had to do it all manually up til now.

cr08 avatar Aug 20 '22 16:08 cr08

alright done, you think thumbnails would be useful or would that take up too much space in the list?

MrBrax avatar Aug 20 '22 17:08 MrBrax

i think that turned out pretty decent

MrBrax avatar Aug 20 '22 18:08 MrBrax

Had a lull in clips to test with but had some come through last night 😄Looks great here and works well so far. Once again, thanks for the work on this. It's greatly appreciated!

cr08 avatar Aug 24 '22 14:08 cr08

sounds good. should probably add something to change the scheduling though, maybe the raw cron text?

MrBrax avatar Aug 24 '22 16:08 MrBrax

Trying to get clips downloaded with no success so far.

Using following settings:

SmartSelect_20221024_211213_Firefox.jpg

After this it doesn't seem to do anything? Even if it would only download every ~24 hours it does not pick anything up.

Speaking of, when does it try to download the clip? The moment a new clip has been created or ever X hours?

CappiSteijns avatar Oct 24 '22 19:10 CappiSteijns

yeah it should run at 00:00 midnight every day i think, and it should output scheduler related stuff to the log, does that not happen?

MrBrax avatar Oct 24 '22 20:10 MrBrax

yeah it should run at 00:00 midnight every day i think, and it should output scheduler related stuff to the log, does that not happen?

Suddenly it worked! It downloaded exactly at 00:00. (As you can see in the log) 2022-10-25.txt

It does give the clips strange names tho as you can see in the pictures. SmartSelect_20221025_001622_Firefox.jpg

Could it be possible to download the clips as soon as they are created? It does happen streamers delete the clips as well as the whole vod.

And right now it will download the last clips from 1 day, would it be possible to download all existing clips using LiveStreamDVR? Yes, I do understand it will take a lot of gb's and most of the clips are not really usefull but I would really like to archive them all.

Thanks for your time!

CappiSteijns avatar Oct 24 '22 22:10 CappiSteijns

the names are just the official clip id's, i made them use the template name now

as soon as they are created?

nope, no such webhook

download all existing clips

technically possible i guess, but you'd probably get banned from the api for downloading tens of thousands of clips

MrBrax avatar Oct 25 '22 07:10 MrBrax

clips also cannot be sorted by anything other than view count as far as i know, so it is what it is

MrBrax avatar Oct 25 '22 08:10 MrBrax

the names are just the official clip id's, i made them use the template name now

as soon as they are created?

nope, no such webhook

download all existing clips

technically possible i guess, but you'd probably get banned from the api for downloading tens of thousands of clips

Thanks for the help and info, seems to be working! :)

CappiSteijns avatar Oct 25 '22 10:10 CappiSteijns

clip downloader gui also added

MrBrax avatar Oct 27 '22 12:10 MrBrax