wallabag icon indicating copy to clipboard operation
wallabag copied to clipboard

Wrong display in wallabag (nitter.net)

Open wallabag-bot opened this issue 2 years ago • 3 comments

Sent by Harold De Voeght and automatically created by email


https://nitter.net/PatriceReviron/status/1721211030355759495

It cannot fetch the content. An idea?

wallabag-bot avatar Jan 17 '24 13:01 wallabag-bot

At the time of writing this comment, nitter.net returns an error

$ curl -i https://nitter.net/PatriceReviron/status/1721211030355759495 
HTTP/2 403 

Using another Nitter instance correctly saves the bookmark, so I'd assume it has something to do with that

jman-schief avatar Jan 18 '24 16:01 jman-schief

I had a short look on it. 403 means 'forbidden', so nitter is preventing to load the real content for non-browsers. I tried to set several different user-agents but had no success. They are doing some 'better' voodoo to identify cURL/wallabag.

Other instances may not blocking crawlers.

HolgerAusB avatar Jan 19 '24 13:01 HolgerAusB

@jman-schief

nitter.net is blocking non-human crawlers, so

This works NOT with wallabag UI

This only works with wallabagger browser-plugin with activated option 'Retrieve content from the browser' in it's settings

If you are self-hosting wallabag, copy nitter.net.txt to your <wallabag>/vendor/j0k3r/graby-site-config/, and clear cache.

For app.wallabag.it we need to wait for the next release.

HolgerAusB avatar Jan 21 '24 09:01 HolgerAusB