chat-downloader icon indicating copy to clipboard operation
chat-downloader copied to clipboard

Published 20 hours ago • verified publisher icon xenova

When will Younow chat download be available?

Open churrodude666 opened this issue 4 years ago • 4 comments

Hi, when will the chat download for Younow be available? I'd be happy to donate or help out with the coding if it sped the process up a little 🙂

churrodude666 avatar Apr 18 '21 12:04 churrodude666

Hi @churrodude666! Sorry for the late response, I've been busy with university for the past few months, but I have some time to work on this project now! :)

I have had younow on my TODO list for quite some time, but I've mainly been busy adding support for YouTube, Twitch and Facebook gaming (the main 3 sites).

It would be amazing if you would like to contribute code to add support for younow! No need to donate or anything; I do this for fun! 😊

xenova avatar Jun 30 '21 18:06 xenova

I took a look a younow and started implementing a basic scraper for chat: https://github.com/xenova/chat-downloader/tree/younow

I am unsure how the chat normally runs (for some reason I was unable to find what requests are being made), so the current implementation basically loads the initial data every second and determines which items it has shown before and which it has not.

I am sure there is a better way, but I haven't been able to completely figure it out. Would appreciate some help if someone is able to! 👍

xenova avatar Jul 02 '21 00:07 xenova

Thanks @xenova for writing this up, I appreciate it! For me it appears to still say that the younow site isn't supported, but I'll try a couple of things to see if it's just on my end :P

churrodude666 avatar Jul 10 '21 15:07 churrodude666

Hi 👋 Yes, that is because it is in the development branch: https://github.com/xenova/chat-downloader/tree/younow and not yet in the live software. I was waiting for your response (and testing) before including it in the main version.

You should be able to test it by downloading that branch and running the module with

python -m chat_downloader <url>

I had never used younow until trying to implement it, so I am sure there are better ways to do what I did; but for the most part it seemed to be working.

Let me know what suggestions you have. Also, I'm not sure if you are able to, but I would greatly appreciate some help in trying to improve the extraction: I couldn't work out exactly how requests are made (e.g., websockets or just polling APIs), so currently it is quite inefficient.

xenova avatar Jul 10 '21 15:07 xenova