Yotter icon indicating copy to clipboard operation
Yotter copied to clipboard

Published 20 hours ago • verified publisher icon ytorg

Add support for livestream videos

Open pluja opened this issue 3 years ago • 5 comments

Livestream videos on Youtube use a m3u8 format. We should get Nginx to stream those files as the retrieving and set-up of the URLs is already done, and also the video-js part for reproducing the hls streams.

pluja avatar Oct 06 '20 16:10 pluja

@FireMasterK do you know how we shoud address this on the Nginx file?

pluja avatar Oct 06 '20 16:10 pluja

Could you send me an example m3u8 file? I'll get a better idea of what to do then

FireMasterK avatar Oct 06 '20 16:10 FireMasterK

@FireMasterK Yes. Here's an example URL:

https://manifest.googlevideo.com/api/manifest/hls_variant/expire/1602026276/ei/xKZ8X9TnJsqd-gajgoSIDw/ip/xxx.32.xxx.231/id/5qap5aO4i9A.0/source/yt_live_broadcast/requiressl/yes/hfr/1/playlist_duration/30/manifest_duration/30/maudio/1/vprv/1/go/1/keepalive/yes/fexp/23915654/dover/11/itag/0/playlist_type/DVR/sparams/expire%2Cei%2Cip%2Cid%2Csource%2Crequiressl%2Chfr%2Cplaylist_duration%2Cmanifest_duration%2Cmaudio%2Cvprv%2Cgo%2Citag%2Cplaylist_type/sig/AOq0QJ8wRQIhAJDk_UcE6XVEfpOWWw_cML0oaf5XrM6VJQm4fXKXs3CdAiAl6OVNyG5UyszLL_XfYUZsb-pa3elqpiBgEKAB68_URQ%3D%3D/file/index.m3u8?disable_polymer=true

Note that I removed the IP from the URL so it won't work.

And the content of the downloaded file can be found here: https://bin.nixnet.services/?3a630bb316eca544#y8RGM6NxfvkYXM4FtiDcoxip72P39fb2FmUyVXV3H1P

You can get the URL using youtube-dl and getting the formats from a livestream url. I used this one /watch?v=5qap5aO4i9A

pluja avatar Oct 06 '20 17:10 pluja

I seem to be getting a different file from youtube-dl, how did you get that url? I just ran youtube-dl -v -f 96 https://www.youtube.com/watch?v=5qap5aO4i9A and this the URL I get.

https://manifest.googlevideo.com/api/manifest/hls_playlist/expire/1602027020/ei/rKl8X9qJKYmw1AaQyL-ICQ/ip/140.238.250.190/id/5qap5aO4i9A.0/itag/96/source/yt_live_broadcast/requiressl/yes/ratebypass/yes/live/1/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-a5mlrn7z.googlevideo.com/playlist_duration/30/manifest_duration/30/vprv/1/playlist_type/DVR/hcs/yes/mh/30/mm/44/mn/sn-a5mlrn7z/ms/lva/mv/u/mvi/3/pl/20/rmhost/r2---sn-a5mlrn7z.googlevideo.com/shardbypass/yes/dover/11/keepalive/yes/fexp/23915654/mt/1602005214/disable_polymer/true/sparams/expire,ei,ip,id,itag,source,requiressl,ratebypass,live,goi,sgoap,sgovp,playlist_duration,manifest_duration,vprv,playlist_type/sig/AOq0QJ8wRQIhAKkKkNgFubGiKkOmeHuNFb8VbjNHf_OIhnbRu1I3LASKAiADRNNK6xFJwVF-wvfSUruom_DP-IMsgo6NyBU7rv3Lnw%3D%3D/lsparams/hls_chunk_host,hcs,mh,mm,mn,ms,mv,mvi,pl,rmhost,shardbypass/lsig/AG3C_xAwRAIgb8tC4IAtBsZBLV0amFSyIPOlYe6Wv61hPQ3NqZXEa3oCIBEFYghu9EBZHeYqjlVdWAnW970wTxxaQ9dl0vMT2rdw/playlist/index.m3u8

#EXTM3U
#EXT-X-VERSION:3
#EXT-X-TARGETDURATION:5
#EXT-X-MEDIA-SEQUENCE:3921074
#EXT-X-DISCONTINUITY-SEQUENCE:12368
#EXT-X-PROGRAM-DATE-TIME:2020-10-06T17:29:47.896+00:00
#EXTINF:5.0,
https://r3---sn-a5mlrn7z.googlevideo.com/videoplayback/id/5qap5aO4i9A.0/itag/96/source/yt_live_broadcast/expire/1602027020/ei/rKl8X9qJKYmw1AaQyL-ICQ/ip/140.238.250.190/requiressl/yes/ratebypass/yes/live/1/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-a5mlrn7z.googlevideo.com/playlist_duration/30/manifest_duration/30/vprv/1/playlist_type/DVR/hcs/yes/mh/30/mm/44/mn/sn-a5mlrn7z/ms/lva/mv/u/mvi/3/pl/20/rmhost/r2---sn-a5mlrn7z.googlevideo.com/shardbypass/yes/keepalive/yes/fexp/23915654/mt/1602005214/disable_polymer/true/sparams/expire,ei,ip,id,itag,source,requiressl,ratebypass,live,goi,sgoap,sgovp,playlist_duration,manifest_duration,vprv,playlist_type/sig/AOq0QJ8wRQIhAKkKkNgFubGiKkOmeHuNFb8VbjNHf_OIhnbRu1I3LASKAiADRNNK6xFJwVF-wvfSUruom_DP-IMsgo6NyBU7rv3Lnw%3D%3D/lsparams/hls_chunk_host,hcs,mh,mm,mn,ms,mv,mvi,pl,rmhost,shardbypass/lsig/AG3C_xAwRAIgb8tC4IAtBsZBLV0amFSyIPOlYe6Wv61hPQ3NqZXEa3oCIBEFYghu9EBZHeYqjlVdWAnW970wTxxaQ9dl0vMT2rdw/playlist/index.m3u8/sq/3921074/goap/clen%3D81201%3Blmt%3D1601976453508501/govp/clen%3D580240%3Blmt%3D1601976453508499/dur/5.000/file/seg.ts
#EXTINF:5.0,
https://r3---sn-a5mlrn7z.googlevideo.com/videoplayback/id/5qap5aO4i9A.0/itag/96/source/yt_live_broadcast/expire/1602027020/ei/rKl8X9qJKYmw1AaQyL-ICQ/ip/140.238.250.190/requiressl/yes/ratebypass/yes/live/1/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-a5mlrn7z.googlevideo.com/playlist_duration/30/manifest_duration/30/vprv/1/playlist_type/DVR/hcs/yes/mh/30/mm/44/mn/sn-a5mlrn7z/ms/lva/mv/u/mvi/3/pl/20/rmhost/r2---sn-a5mlrn7z.googlevideo.com/shardbypass/yes/keepalive/yes/fexp/23915654/mt/1602005214/disable_polymer/true/sparams/expire,ei,ip,id,itag,source,requiressl,ratebypass,live,goi,sgoap,sgovp,playlist_duration,manifest_duration,vprv,playlist_type/sig/AOq0QJ8wRQIhAKkKkNgFubGiKkOmeHuNFb8VbjNHf_OIhnbRu1I3LASKAiADRNNK6xFJwVF-wvfSUruom_DP-IMsgo6NyBU7rv3Lnw%3D%3D/lsparams/hls_chunk_host,hcs,mh,mm,mn,ms,mv,mvi,pl,rmhost,shardbypass/lsig/AG3C_xAwRAIgb8tC4IAtBsZBLV0amFSyIPOlYe6Wv61hPQ3NqZXEa3oCIBEFYghu9EBZHeYqjlVdWAnW970wTxxaQ9dl0vMT2rdw/playlist/index.m3u8/sq/3921075/goap/clen%3D81056%3Blmt%3D1601976453508511/govp/clen%3D476821%3Blmt%3D1601976453508509/dur/5.000/file/seg.ts
#EXTINF:5.0,
https://r3---sn-a5mlrn7z.googlevideo.com/videoplayback/id/5qap5aO4i9A.0/itag/96/source/yt_live_broadcast/expire/1602027020/ei/rKl8X9qJKYmw1AaQyL-ICQ/ip/140.238.250.190/requiressl/yes/ratebypass/yes/live/1/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-a5mlrn7z.googlevideo.com/playlist_duration/30/manifest_duration/30/vprv/1/playlist_type/DVR/hcs/yes/mh/30/mm/44/mn/sn-a5mlrn7z/ms/lva/mv/u/mvi/3/pl/20/rmhost/r2---sn-a5mlrn7z.googlevideo.com/shardbypass/yes/keepalive/yes/fexp/23915654/mt/1602005214/disable_polymer/true/sparams/expire,ei,ip,id,itag,source,requiressl,ratebypass,live,goi,sgoap,sgovp,playlist_duration,manifest_duration,vprv,playlist_type/sig/AOq0QJ8wRQIhAKkKkNgFubGiKkOmeHuNFb8VbjNHf_OIhnbRu1I3LASKAiADRNNK6xFJwVF-wvfSUruom_DP-IMsgo6NyBU7rv3Lnw%3D%3D/lsparams/hls_chunk_host,hcs,mh,mm,mn,ms,mv,mvi,pl,rmhost,shardbypass/lsig/AG3C_xAwRAIgb8tC4IAtBsZBLV0amFSyIPOlYe6Wv61hPQ3NqZXEa3oCIBEFYghu9EBZHeYqjlVdWAnW970wTxxaQ9dl0vMT2rdw/playlist/index.m3u8/sq/3921076/goap/clen%3D81515%3Blmt%3D1601976453508521/govp/clen%3D579631%3Blmt%3D1601976453508519/dur/5.000/file/seg.ts
#EXTINF:5.0,
https://r3---sn-a5mlrn7z.googlevideo.com/videoplayback/id/5qap5aO4i9A.0/itag/96/source/yt_live_broadcast/expire/1602027020/ei/rKl8X9qJKYmw1AaQyL-ICQ/ip/140.238.250.190/requiressl/yes/ratebypass/yes/live/1/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-a5mlrn7z.googlevideo.com/playlist_duration/30/manifest_duration/30/vprv/1/playlist_type/DVR/hcs/yes/mh/30/mm/44/mn/sn-a5mlrn7z/ms/lva/mv/u/mvi/3/pl/20/rmhost/r2---sn-a5mlrn7z.googlevideo.com/shardbypass/yes/keepalive/yes/fexp/23915654/mt/1602005214/disable_polymer/true/sparams/expire,ei,ip,id,itag,source,requiressl,ratebypass,live,goi,sgoap,sgovp,playlist_duration,manifest_duration,vprv,playlist_type/sig/AOq0QJ8wRQIhAKkKkNgFubGiKkOmeHuNFb8VbjNHf_OIhnbRu1I3LASKAiADRNNK6xFJwVF-wvfSUruom_DP-IMsgo6NyBU7rv3Lnw%3D%3D/lsparams/hls_chunk_host,hcs,mh,mm,mn,ms,mv,mvi,pl,rmhost,shardbypass/lsig/AG3C_xAwRAIgb8tC4IAtBsZBLV0amFSyIPOlYe6Wv61hPQ3NqZXEa3oCIBEFYghu9EBZHeYqjlVdWAnW970wTxxaQ9dl0vMT2rdw/playlist/index.m3u8/sq/3921077/goap/clen%3D81005%3Blmt%3D1601976453508531/govp/clen%3D492338%3Blmt%3D1601976453508529/dur/5.000/file/seg.ts
#EXTINF:5.0,
https://r3---sn-a5mlrn7z.googlevideo.com/videoplayback/id/5qap5aO4i9A.0/itag/96/source/yt_live_broadcast/expire/1602027020/ei/rKl8X9qJKYmw1AaQyL-ICQ/ip/140.238.250.190/requiressl/yes/ratebypass/yes/live/1/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-a5mlrn7z.googlevideo.com/playlist_duration/30/manifest_duration/30/vprv/1/playlist_type/DVR/hcs/yes/mh/30/mm/44/mn/sn-a5mlrn7z/ms/lva/mv/u/mvi/3/pl/20/rmhost/r2---sn-a5mlrn7z.googlevideo.com/shardbypass/yes/keepalive/yes/fexp/23915654/mt/1602005214/disable_polymer/true/sparams/expire,ei,ip,id,itag,source,requiressl,ratebypass,live,goi,sgoap,sgovp,playlist_duration,manifest_duration,vprv,playlist_type/sig/AOq0QJ8wRQIhAKkKkNgFubGiKkOmeHuNFb8VbjNHf_OIhnbRu1I3LASKAiADRNNK6xFJwVF-wvfSUruom_DP-IMsgo6NyBU7rv3Lnw%3D%3D/lsparams/hls_chunk_host,hcs,mh,mm,mn,ms,mv,mvi,pl,rmhost,shardbypass/lsig/AG3C_xAwRAIgb8tC4IAtBsZBLV0amFSyIPOlYe6Wv61hPQ3NqZXEa3oCIBEFYghu9EBZHeYqjlVdWAnW970wTxxaQ9dl0vMT2rdw/playlist/index.m3u8/sq/3921078/goap/clen%3D81303%3Blmt%3D1601976453508541/govp/clen%3D561285%3Blmt%3D1601976453508539/dur/5.000/file/seg.ts
#EXTINF:5.0,
https://r3---sn-a5mlrn7z.googlevideo.com/videoplayback/id/5qap5aO4i9A.0/itag/96/source/yt_live_broadcast/expire/1602027020/ei/rKl8X9qJKYmw1AaQyL-ICQ/ip/140.238.250.190/requiressl/yes/ratebypass/yes/live/1/goi/160/sgoap/gir%3Dyes%3Bitag%3D140/sgovp/gir%3Dyes%3Bitag%3D137/hls_chunk_host/r3---sn-a5mlrn7z.googlevideo.com/playlist_duration/30/manifest_duration/30/vprv/1/playlist_type/DVR/hcs/yes/mh/30/mm/44/mn/sn-a5mlrn7z/ms/lva/mv/u/mvi/3/pl/20/rmhost/r2---sn-a5mlrn7z.googlevideo.com/shardbypass/yes/keepalive/yes/fexp/23915654/mt/1602005214/disable_polymer/true/sparams/expire,ei,ip,id,itag,source,requiressl,ratebypass,live,goi,sgoap,sgovp,playlist_duration,manifest_duration,vprv,playlist_type/sig/AOq0QJ8wRQIhAKkKkNgFubGiKkOmeHuNFb8VbjNHf_OIhnbRu1I3LASKAiADRNNK6xFJwVF-wvfSUruom_DP-IMsgo6NyBU7rv3Lnw%3D%3D/lsparams/hls_chunk_host,hcs,mh,mm,mn,ms,mv,mvi,pl,rmhost,shardbypass/lsig/AG3C_xAwRAIgb8tC4IAtBsZBLV0amFSyIPOlYe6Wv61hPQ3NqZXEa3oCIBEFYghu9EBZHeYqjlVdWAnW970wTxxaQ9dl0vMT2rdw/playlist/index.m3u8/sq/3921079/goap/clen%3D81376%3Blmt%3D1601976453508551/govp/clen%3D505383%3Blmt%3D1601976453508549/dur/5.000/file/seg.ts

FireMasterK avatar Oct 06 '20 17:10 FireMasterK

My best idea on how to approach this would probably be to use python to replace the googlevideo hostname with the instance one and append &host= to each of those URLs.

I would approach this by checking each line by line and seeing if it is a URL, if it is, just rewrite the URL like above.

Here's my current config for videostreaming, It should work perfectly with this.

    location ~ (^/videoplayback$|/videoplayback/|/vi/|/a/) {
         proxy_buffering off;
         resolver 1.1.1.1 ipv6=off;
         proxy_pass https://$arg_host;
         proxy_set_header Host $arg_host;
         proxy_ssl_server_name on;
         proxy_set_header X-Forwarded-For ""; # Only for cloudflared instances
         proxy_set_header CF-Connecting-IP ""; # Only for cloudflared instances
         add_header Access-Control-Allow-Origin *;
         sendfile on;
         tcp_nopush on;
         aio threads=default;
     }

FireMasterK avatar Oct 06 '20 18:10 FireMasterK