Chocobozzz
Transcription widget as in youtube
Transcription widget as in youtube
User story I use frequently the Transcription UI combined with the browser search functionality to find back when in a video something were said. It then allow me to better source information back to a video with a timestamp.
Advantages for PeerTube Easing the sourcing to PeerTube could promote it (Timestamped sourcing would be better). The lack of this functionality would make me stick whit YouTube for conference watching at least. witch could be detrimental to PeerTube at my scale.
Existing version
This need to be integrated for deafblind users.
Below I will present three use cases for descriptive transcripts and or video transcripts: accessibility, content moderation and search algorithm.
Accessibility
Here is the W3C protocols: https://www.w3.org/WAI/media/av/transcripts/
Netflix's extremely wonky implementation of this feature: https://assets.nflxext.com/ffe/siteui/accessibility/DeafUDescriptiveTranscript.htm. Yes, Netflix makes their subscribers load an entire separate window to watch alongside their movies or TV shows.
Here you see a news channel providing transcript alongside subtitles: https://www.dailymoth.com/blog/deaf-run-theater-riksteatern-crea-hosts-sign-language-arts-event. It is not uncommon to see people upload transcripts externally to Tumblr or Google Drive.
Other people pin transcript in the comment section or paste them into the video description.
Part of why people host transcript externally outside of YouTube, despite YouTube having the feature, is because YouTube hides the transcript in a very inaccessible GUI:
Content Moderation and Search/Discovery Algothrim
I think up until like 3 years ago, YouTube's algorithm heavily relies on automatically-generated transcripts since 2008. YouTube now uses Cloud Vision API for content recommendation.
I believe prior to using Cloud Vision API in 2018 for content moderation, a good video transcript account for something like 25% of traffic to a video. Good subtitles or closed captions account for about 10%.
Also, I think for the longest time, YouTube's anti-spam mechanism is whether or not the first minute of the automatically-generated speech-to-text matches the title of the video and the first 150 characters of the video description. That metric has been devalued in favour of the Cloud Vision API.
Treating subtitle tracks as interactive transcripts exists as plugins for video.js according to W3C and according this page: Web-Based Media Player Accessibility Comparison Table
Original: https://www.npmjs.com/package/videojs-transcript-ac (https://github.com/walsh9/videojs-transcript) Forked: https://www.npmjs.com/package/@packt/videojs-transcript
Here is a live example: https://walsh9.github.io/videojs-transcript/example.html
Not the same as a separate box or feature to host descriptive transcripts for blind users though. Not sure if that should be treated as a separate issue than this one.
Implemented in https://github.com/Chocobozzz/PeerTube/commit/be4bf80883f693b701789b6c0167576da1f57daa (will be released in next peertube version, 6.3)
Documentation already available on https://docs.joinpeertube.org/use/watch-video#transcription-widget
