popcorn-api icon indicating copy to clipboard operation
popcorn-api copied to clipboard

Movie scraping doesn't seem to be working, or DB not updating

Open nicksaintjohn opened this issue 3 years ago • 12 comments

Expected Behavior

Movies scraper should update

Actual Behavior

Movies scraper is not updating

Steps to Reproduce the Problem

Return from serv01 :-

{"repo":"https://github.com/popcorn-official/popcorn-api.git","server":"serv01","status":"Idle","totalAnimes":704,"totalMovies":20361,"totalShows":4640,"updated":1604570400,"uptime":687429,"version":"2.2.3","commit":"6c8a9a4"}

  1. Check the status, and note the "totalMovies" value.
  2. Wait for a day
  3. Check again. Value should have changed over time, either adding or losing discovered movies.

NB: Shows scraper is updating fine

Specifications

  • Version: 2.2.3
  • Platform: Unknown
  • Subsystem: Unknown

nicksaintjohn avatar Nov 05 '20 10:11 nicksaintjohn

This is the server hosted at https://tv-v2.api-fetch.sh - Does anyone know who has access to this, to fix?

nicksaintjohn avatar Nov 05 '20 10:11 nicksaintjohn

I can confirm this

Saphyel avatar Nov 07 '20 18:11 Saphyel

Could this possibly relate to PR #133 whereby perhaps the scraper URL is failing on just the movies lookup?

Again, does anyone know who has access to the aforementioned deployment? Perhaps the CI script needs fixing, to update that way? I've not idea how it's configured. Thanks.

nicksaintjohn avatar Nov 14 '20 16:11 nicksaintjohn

Any updates?

parthsaxena avatar Dec 21 '20 23:12 parthsaxena

This is the server hosted at https://tv-v2.api-fetch.sh - Does anyone know who has access to this, to fix?

nicksaintjohn, did you find a solution to https://tv-v2.api-fetch.sh? do you knwo why nobody is able to fix the update problem on the API (it is strange becuase the API is ansering but just old content, nothing new).

Do you know if is there nay way to use the API of getpopcorntime.is? i can not use the v0.4.4 version and change manually the api becuase i'm using KODI with an addon from https://github.com/markop159/KODI-Popcorn-Time, who was using https://tv-v2.api-fetch.sh.

Thanks, MFM

mflorezm avatar Jan 02 '21 18:01 mflorezm

I've finally had time to do some updates and fixes to PopcornTimeTV. It's now working relatively well in tvOS 14, with a hack to get search working properly again. It's a true hack, so far from perfect, but it saves you from having to quit and reload the app every now and then.

I've also switched (for now) to an alternative scraper. I have no idea who hosts it, so I may have to switch back, but it's still updating, so recent items appear on there reliably (despite the minimal releases these days).

Let me know how you get on... More updates to follow.

https://github.com/nicksaintjohn/PopcornTimeTV/tree/tvOS-14-fix

nicksaintjohn avatar Feb 18 '21 03:02 nicksaintjohn

Good stuff. Can you provide ipa ?

kowalos avatar Mar 12 '21 11:03 kowalos

Would appreciate an updated .IPA too.. 🙏🏻

buggyjim avatar Mar 23 '21 23:03 buggyjim

@nicksaintjohn maybe you can be a trie saint and correct the server issues. You keen followers need a working .ipa

buggyjim avatar Apr 22 '21 16:04 buggyjim

@buggyjim now api server is down, and i think forever http://popcorn-ru.tk/ is only one working now server with know and open api @nicksaintjohn maybe add option in ios and tvos app for set api server? It's not first lockdown.

ivan1986 avatar Apr 22 '21 18:04 ivan1986

Hey guys,

Sadly, scrapers seem to be increasingly hard to find, and yes, the Russian scraper seems to be our only option for now... I'll maybe switch 'Shows' over to that too - I need to find out what the URL is for it. It's a nice idea to add a scraper configuration option - I'll try to do that, when I have time!

The best solution right now looks to be in migrating the Movies and TV API to the newer mechanism (as seen in the more recent official Popcorn Time apps). I've not looked into this myself, but I don't expect it to be a simple task - I also can't say if I'll ever get around to it.

nicksaintjohn avatar Apr 27 '21 16:04 nicksaintjohn

Ok! Try my latest branch out guys...

https://github.com/nicksaintjohn/PopcornTimeTV/tree/pctapi-switch

Let me know if you can get it running. It's a bit buggy, but gets everything is now working again, using the 'current' scraper (used by the more recent apps). Sadly it's a big re-write, and incompatible with the older API, so I can't incorporate a scraper-switching option, as it would take too long to code it all.

Good luck!

nicksaintjohn avatar Apr 29 '21 01:04 nicksaintjohn