rss-bridge icon indicating copy to clipboard operation
rss-bridge copied to clipboard

Problems with Facebook on public RSS-Bridge instances

Open em92 opened this issue 3 years ago • 107 comments

Due to many recent You must be logged in to view this page. This is not supported by RSS-Bridge issues coming from Facebook users (https://github.com/RSS-Bridge/rss-bridge/issues/2041, comments from https://github.com/RSS-Bridge/rss-bridge/issues/2014, https://github.com/RSS-Bridge/rss-bridge/issues/2037) I investigated those issues more clearly.

If I open "https://www.facebook.com/facebook/posts" from my home laptop, everything is fine posts are returned. If I open "https://www.facebook.com/facebook/posts" from my public instance (https://feed.eugenemolotov.ru), it will return redirect to login page.

Looks like FacebookBridge has the same problems as InstagramBridge (https://github.com/RSS-Bridge/rss-bridge/issues/1891), which breaks using FacebookBridge on public RSS-Bridge instances.

Possible solutions for users (same as in metioned InstagramBridge):

  • Deploy RSS-Bridge on your personal PC or laptop and use FacebookBridge from there.
  • Deploy RSS-Bridge on your VPS, make sure that only certain people use it and use FacebookBridge from there.

em92 avatar Apr 04 '21 09:04 em92

Thank you very much for investigating. I'm using shared hosting for mine and it's folder protected so only I have access, but it probably just checks the IP and since it's shared hosting, it's heavily used. May have to pay for a private IP in that case.

grivanov avatar Apr 04 '21 12:04 grivanov

I installed it on my vps (Infomaniak, Switzerland) and I am the only one using it. Unfortunately it doesn't work either. I tried to visit a Facebook page with Firefox and it automatically redirects me to the login page.

mrtpcet avatar Apr 04 '21 18:04 mrtpcet

I'm running my single-user RSS Bridge instance on Digital Ocean, and feeds which were giving me error 500 since April 1st just started working again. Let's see for how long...

Edit: stopped working two hours later.

arcctgx avatar Apr 05 '21 14:04 arcctgx

I am having exactly this problem for 1 week. Over 100 feeds created through Facebook main site bridge result in errors. I am using my personal laptop, so this cannot be the reason. Yesterday, 3 feeds (out of the 100+) delivered lots of previous missed articles ; today, only 1 out of 100+ is working. Looks like it is random and erratic. I am using them to deliver a daily news digest, it's been 1 week I cannot do it properly and need to check all sources 1 by 1. It is not efficient and time-consuming. What should I do?

Noutladeesse avatar Apr 06 '21 13:04 Noutladeesse

If I open "https://www.facebook.com/facebook/posts" from my home laptop, everything is fine posts are returned. If I open "https://www.facebook.com/facebook/posts" from my public instance (https://feed.eugenemolotov.ru), it will return redirect to login page.

Hi @em92 ,

If you remove the /posts part of the url then you don't get the login page show, even on a public instance.

eg

https://www.facebook.com/facebook/posts (redirect to login page)

https://www.facebook.com/facebook (no redirect, page content shown).

Did you try that?

tstanbur avatar Apr 06 '21 15:04 tstanbur

@tstanbur I have the same problem than @Noutladeesse I dont understand how I can modify https://www.facebook.com/facebook/posts to https://www.facebook.com/facebook, I have an rss feed without facebook inside.

ghost avatar Apr 07 '21 11:04 ghost

@tstanbur I have the same problem than @Noutladeesse I dont understand how I can modify https://www.facebook.com/facebook/posts to https://www.facebook.com/facebook, I have an rss feed without facebook inside.

I have the same issue too!

I was just trying to help fix it, hopefully @em92 can (I think he's the author?)

tstanbur avatar Apr 07 '21 12:04 tstanbur

@tstanbur understand, my english is too poor. :)

ghost avatar Apr 07 '21 12:04 ghost

@tstanbur understand, my english is too poor. :)

@cborne : @tstanbur a le même problème que nous bien que ses RSS feeds ne soient pas de feeds de Facebook, il demande si @em92 est l'auteur et s'il peut nous aider à résoudre le problème (je traduis !)

Noutladeesse avatar Apr 07 '21 14:04 Noutladeesse

@Noutladeesse merci j'ai fini par comprendre par la suite, au départ je ne comprenais pas ce que faisaient les urls en facebook au milieu mais il s'agit d'une proposition de correction pour @em92. L'anglais c'est pas vraiment comme le vélo, quand tu le pratiques pas ça revient pas tout seul. :)

ghost avatar Apr 07 '21 14:04 ghost

@Noutladeesse merci j'ai fini par comprendre par la suite, au départ je ne comprenais pas ce que faisaient les urls en facebook au milieu mais il s'agit d'une proposition de correction pour @em92. L'anglais c'est pas vraiment comme le vélo, quand tu le pratiques pas ça revient pas tout seul. :)

:-D Oui c'est une proposition de correction, mais ça ne marche pas pour les feeds déjà créés.

Noutladeesse avatar Apr 07 '21 15:04 Noutladeesse

Just another small "me too". I'm running RSS-Bridge on my personal VPS (only user) since a long while (~2 years) and I'm also affected by the issue. It started about 1-2 weeks ago, then it started working on Monday and was ok for about 2 days and now it stopped again.

It does seem like an Facebook action to block RSS-Bridge (probably with their silly reasoning that this would somehow make the people go back to using their awful service…)

woj-tek avatar Apr 08 '21 05:04 woj-tek

Here just one more ''me too''. I specifically signed up here on Github to ask a few things about the Facebook bridge. Until last week, I had been using a public host from Eugene Molotov to my full satisfaction for about a year (thanks a lot). I don't have any technical background, so it is sometimes difficult for me to be able to keep up with all the terms that come up with this topic here.

I wonder if the above and below option mentioned by em92 still works and how I could get it running on my own PC:

Deploy RSS-Bridge on your personal PC or laptop and use FacebookBridge from there.

I would be very happy if I could still use the Facebook Bridge in this way, but I am not sure if this still works and how to install it on my own PC. I have looked through github quite a bit, but unfortunately I can't figure it out myself, which is why I decided to sign up.

If users could confirm or deny that this feature still works, I would be happy with that. Then my next question would be how I can best put the bridge on my own PC or who I can ask for help or get information how to do so. I also think it would be a very good idea to start a donation fund to get a developer to maintain the facebook bridge and make also the instagram bridge work again. That way, we can all contribute to get our beloved feeds going again. Greetings from the Netherlands and thanks for your great work over the years!

RealDutchie avatar Apr 08 '21 18:04 RealDutchie

Same here. Since April I got different errors in the same Feeds, like:

"Facebook Bridge | Main Site was unable to receive or process the remote website's content! Error message: `You must be logged in to view this page. This is not supported by RSS-Bridge."

"Facebook Bridge | Main Site was unable to receive or process the remote website's content! Error message: `The requested resource cannot be found!"

"Facebook Bridge | Main Site was unable to receive or process the remote website's content! Error message: Call to a member function children() on null Query string: action=display&bridge=Facebook&u=hyperlitemountaingear&media_type=all&limit=1000&format=Atom Version: dev.2020-11-10" Latest version of RSS-Bridge…

hellmachine2000 avatar Apr 08 '21 22:04 hellmachine2000

I've been having these errors as well and I found that changing the cache_timeout parameter in FacebookBridge seems to reset the bridge, but it only works for a little while. I've tried 86400, 43200, 21600, 1, 0, and even eliminating the parameter. Somehow resetting the cache every time the bridge is called might be the solution to this problem?

ghost avatar Apr 09 '21 02:04 ghost

I've been having these errors as well and I found that changing the cache_timeout parameter in FacebookBridge seems to reset the bridge, but it only works for a little while. I've tried 86400, 43200, 21600, 1, 0, and even eliminating the parameter. Somehow resetting the cache every time the bridge is called might be the solution to this problem?

Thank you for suggesting @Mthmgcn05 How do you reset the cache? (I am not an IT professional, only a user)

Noutladeesse avatar Apr 09 '21 07:04 Noutladeesse

After more testing and thought, it may be every time I redeployed, it worked for five minutes, so that could have been resetting it.

ghost avatar Apr 09 '21 12:04 ghost

It's seems that adding cookie "c_user=XXXX" where XXXX is my ID from Facebook cookie helped. I don't know how to add this only via Bridge, so I did it via contents.php for all requests, which is really bad, but... maybe it's the way for better solution :-)

EDIT: False alarm, not working again...

miwcz avatar Apr 09 '21 21:04 miwcz

@miwcz on my public instance I used c_user and xs values. Quick and dirty patch looks like this:

diff --git a/bridges/FacebookBridge.php b/bridges/FacebookBridge.php
index c03de4e..fafeabd 100644
--- a/bridges/FacebookBridge.php
+++ b/bridges/FacebookBridge.php
@@ -174,6 +174,8 @@ class FacebookBridge extends BridgeAbstract {
 		} else {
 			$header = array();
 		}
+		$header[] = 'Cookie: c_user=xxxx; xs=yyyy;';
+
 
 		$touchURI = str_replace(
 			'https://www.facebook',
@@ -560,11 +562,15 @@ EOD;
 				$header = array();
 			}
 
+			$header[] = 'Cookie: c_user=xxxx; xs=yyyy;';
+
+
 			$html = getSimpleHTMLDOM($this->getURI(), $header)
 				or returnServerError('No results for this query.');
 
 		}
 
 		// Handle captcha form?
 		$captcha = $html->find('div.captcha_interstitial', 0);
 

So far, so good.

em92 avatar Apr 10 '21 08:04 em92

So far, so good.

I meant it is working on my instance at the moment.

em92 avatar Apr 10 '21 08:04 em92

@tstanbur

hopefully @em92 can (I think he's the author?)

I am not author of this bridge. I maintain RSS-Bridge in general (reviewing pull requests, pinging bridge maintainers in issues) and bridges for Pikabu and Vk.

Usually maintainer of the bridge does fix bugs, but we don't have maintainer for Facebook bridge. I have little time to fix bugs in bridges, that I don't maintain.

em92 avatar Apr 10 '21 08:04 em92

I have 20+ facebook feeds and this is working only for 4-5 first requests. It seems that facebook is blocking mutliple requests after short while.

miwcz avatar Apr 10 '21 11:04 miwcz

@tstanbur

hopefully @em92 can (I think he's the author?)

I am not author of this bridge. I maintain RSS-Bridge in general (reviewing pull requests, pinging bridge maintainers in issues) and bridges for Pikabu and Vk.

Usually maintainer of the bridge does fix bugs, but we don't have maintainer for Facebook bridge. I have little time to fix bugs in bridges, that I don't maintain.

Is there anyone who maintains Facebook bridge? @em92

Noutladeesse avatar Apr 10 '21 19:04 Noutladeesse

I meant it is working on my instance at the moment.

Now it does not. Facebook disabled my account 'cos my account violates it's community standards. It pursuaded me to upload my photo (I did it, the real photo of me) and now I am waiting for reviewing.

em92 avatar Apr 11 '21 01:04 em92

@Noutladeesse

Is there anyone who maintains Facebook bridge?

No.

em92 avatar Apr 11 '21 01:04 em92

I don't have any new information to add that other users haven't already discussed. I'm only here to say that it is happening to me too. I am running FB Bridge on Heroku and using Feedly to save the feeds. I started getting Bridge returned error 500! around the beginning of April.

Some feeds only get the error occasionally. Other feeds keep getting the error constantly, which makes those feeds useless.

Example error message:

Facebook Bridge | Main Site was unable to receive or process the remote website's content!
Error message: `You must be logged in to view this page. This is not supported by RSS-Bridge.`
Query string: `action=display&bridge=Facebook&context=User&u=[REDACTED]&media_type=all&limit=-1&format=Atom`
Version: `dev.2020-02-26`

    Press Return to check your input parameters
    Press F5 to retry
    Check if this issue was already reported on GitHub (give it a thumbs-up)
    Open a GitHub Issue if this error persists

teromene, logmanoriginal

pin-grid-array avatar Apr 11 '21 17:04 pin-grid-array

Here is final of my story, where I tried to make FacebookBridge work in my public instance (https://feed.eugenemolotov.ru) using my account with real phone number and patch from https://github.com/RSS-Bridge/rss-bridge/issues/2047#issuecomment-817099508.

r1zbxfG

I didn't read their paper with title "Community standards", but it looks like it sharing posts via RSS does not follow it.

em92 avatar Apr 12 '21 05:04 em92

It most likely boils down to "overusing API" or "harvesting data". Which just a tad silly.

For me using RSS-Bridge (and RSS in general) it to avoid having facebook account and be able to follow some websites that for some twisted reason are being present only there...

woj-tek avatar Apr 12 '21 07:04 woj-tek

So I think I may have possibly discovered the issue.

I have put rss-bridge on my own server on my computer and realized after putting in the switch for debugging that Facebook responds in two different ways in the url header:

https://www.facebook.com/login/?next=https%3A%2F%2Fwww.facebook.com%2FXXXXXXXXXXXXX%2Fposts

and

https://www.facebook.com/XXXXXXXXXXXXX/posts?_fb_noscript=1

where XXXXXXXXXXXXX is the page id and the first gives the error:

'You must be logged in to view this page. This is not supported by RSS-Bridge.'

The second response gives the posts as requested.

I'm no programmer, but if one could clean up the first response to make it look like the second and then continue onto the rest of the code, I think the bridge would work.

ghost avatar Apr 12 '21 15:04 ghost

@Mthmgcn05 I already mentioned this facebook behavior in first message of this issue.

em92 avatar Apr 12 '21 17:04 em92