SponsorBlock icon indicating copy to clipboard operation
SponsorBlock copied to clipboard

Detect intros

Open turkeyphant opened this issue 3 years ago • 3 comments

I searched around and couldn't find anything about this.

Is there any way for SponsorBlock to detect intros? When a channel uses exactly the same intro sequence on every video but not always exactly at the beginning?

Could SponsorBlock read the video footage and skip the same section on every video where it appears? Or at least is there a fast workflow to automatically mark these?

turkeyphant avatar Aug 23 '22 15:08 turkeyphant

I am not familiar with the code and infrastructure of SponsorBlock, but here is what I think: It's a nice idea, but in my opinion and to the best of my knowledge rather unrealistic. Not only would the server need to run some sort of computer vision program to process all the video (which is expensive and would take a while), but it would also be extremely difficult to universally recognize whether, for example, a text that is in an opening scene is an intro or already the beginning of the main content. It would be much easier with movies or TV series e.g. on Netflix, where one can assume a more or less similar structure and duration of intro, recap, outro, ... YouTube videos, however, do not follow such a structure - some videos even contain only an intro and nothing else.

Jan-Koll avatar Aug 24 '22 07:08 Jan-Koll

I am not familiar with the code and infrastructure of SponsorBlock, but here is what I think: It's a nice idea, but in my opinion and to the best of my knowledge rather unrealistic. Not only would the server need to run some sort of computer vision program to process all the video (which is expensive and would take a while), but it would also be extremely difficult to universally recognize whether, for example, a text that is in an opening scene is an intro or already the beginning of the main content. It would be much easier with movies or TV series e.g. on Netflix, where one can assume a more or less similar structure and duration of intro, recap, outro, ... YouTube videos, however, do not follow such a structure - some videos even contain only an intro and nothing else.

Could it not be done locally in browser by the extension? Or at least give a "hint" when adding your own sections?

turkeyphant avatar Aug 24 '22 09:08 turkeyphant

There are certain projects that are automating detection like NN-Block and there are also proof of concepts for jumping on video transitions.

Automated times https://github.com/ajayyy/SponsorBlock/issues/799

Disclaimer for automated segments https://wiki.sponsor.ajay.app/w/Automating_Submissions

mchangrh avatar Aug 25 '22 17:08 mchangrh