scraping-tutorial icon indicating copy to clipboard operation
scraping-tutorial copied to clipboard

Need Help with Scraping

Open LincCodes opened this issue 2 years ago • 1 comments

Hey, have read your well-structured documentation on web scraping.

I am a JavaScript developer who uses axios and cheerio to web scrape (They work just like (jsoup in Kotlin)

I have a hard time extracting video in movies sites like sflix.to or zoro.to and I was asking if you make try to make me understand how it's done.

I have seen the source code of CloudStream but I don't know Kotlin so I have a hard time understanding what the code does and how to follow the execution of the program.

I have tried researching on this but to no avail so your assistance will high be appreciated.

Regards.

LincCodes avatar Jun 29 '22 14:06 LincCodes

What part of it is hard to understand?

  1. Get source IDs
  2. Get servers
  3. Get iframe urls
  4. Solve recaptcha
  5. Get video links from embed

Currently they don't use polling in sflix so that can be safely ignored. Zoro uses polling, but I don't think our code works :shrug: Either way try to replicate this for polling in zoro, our code is pretty shit. They basically run a websocket in the background while streaming to ensure it's viewed on their site. image image

Blatzar avatar Jun 29 '22 21:06 Blatzar