SCrawler icon indicating copy to clipboard operation
SCrawler copied to clipboard

[BUG] RedGifs data is not downloading

Open AAndyProgram opened this issue 3 years ago • 3 comments

On August 31, RedGifs changed the API requirements. These changes cause an error on downloading. Unfortunately, at this time, I still cannot resolve this issue.

Starting from version 2022.9.8.0, downloading data from the RedGifs site is temporary disabled. You can still add RedGifs profiles, but they won't download. You will be able to download them when this issue is fixed.

If you know how to solve this issue, you can post a suggestion in a comment on this post.

AAndyProgram avatar Sep 05 '22 09:09 AAndyProgram

Still nothing has changed. I tried downloading the HTML page and parsing it and it worked for a few minutes, but then they blocked my IP (I think) and I started getting the "Invalid signature" error again.

AAndyProgram avatar Sep 16 '22 16:09 AAndyProgram

I've been trying to resolve this as well, mostly via ideas posted here: https://www.reddit.com/r/DataHoarder/comments/x67zfo/redgifs_api_now_blocked_from_hotlinking_anyone/ and here: https://github.com/RipMeApp/ripme/issues/1994#issuecomment-1235137334 and via their api page (all of which you've probably already seen, but I thought I'd share just in case) https://github.com/Redgifs/api/wiki/API-access

The-Morrighan avatar Sep 19 '22 02:09 The-Morrighan

Already seen and follow. This doesn't work

AAndyProgram avatar Sep 19 '22 02:09 AAndyProgram

Fixed. Please update to the latest release. If you like SCrawler, please like the program on this site: https://alternativeto.net/software/scrawler/about/.

AAndyProgram avatar Oct 18 '22 09:10 AAndyProgram

Just tried to rip https://www.reddit.com/user/slaysheslays and it didn't capture any video from Redgifs

Ihatetotank avatar Oct 19 '22 23:10 Ihatetotank

Read the guide and site requirements

AAndyProgram avatar Oct 20 '22 07:10 AAndyProgram

It seems RedGifs has changed something again. Today I started getting a 401 (Unauthorized) error. I think authorization needs more than a bearer token and cookies.

FYI. Cookies are valid for a very short term. The bearer token refreshes every request. I think one bearer token could be valid for the duration of the cookies, but I'm not sure.

If you know how to solve this issue, you can post a suggestion in a comment on this post.

AAndyProgram avatar Oct 21 '22 10:10 AAndyProgram

Hm... RedGifs seems to still work. RedGifs media posted on Reddit download without problems. The authorization error only occurs when loading a RedGifs profile. It can't get data for request https://api.redgifs.com/v2/users/UserName/search?order=recent

AAndyProgram avatar Oct 21 '22 20:10 AAndyProgram

A plain curl seems to work fine. Maybe RedGifs were still experimenting stuff on their servers?

$ curl 'https://api.redgifs.com/v2/users/celebs/search?order=recent'
{"page":1,"pages":12,"total":341,"gifs":[{"id":"oblongclosesiskin","createDate":1651916881, #snib

altbdoor avatar Oct 23 '22 04:10 altbdoor

You are right! It doesn't require cookies and token! Just a simple request without authorization! Brilliant! Thank you! Actually, I didn't even think about the test without credentials!

AAndyProgram avatar Oct 23 '22 09:10 AAndyProgram

Fixed. Please update to the latest release. If you like SCrawler, please like the program on this site: https://alternativeto.net/software/scrawler/about/.


Get RedGifs temporary token

GET /v2/auth/temporary HTTP/1.1
Host: api.redgifs.com
Accept: application/json

{
 "token":"...",
 "addr":"2a00::579f:3c01:b94e",
 "agent":"curl/7.81.0",
 "rtfm":"https://github.com/Redgifs/api/wiki/API-access"
}

Get specific post data (token required): https://api.redgifs.com/v2/gifs/<PostID>?views=yes&users=yes Get a list of the user's posts (nothing required): https://api.redgifs.com/v2/users/<UserID>/search?order=recent

AAndyProgram avatar Oct 23 '22 14:10 AAndyProgram

Dang, did it break again?

Ihatetotank avatar Dec 04 '22 05:12 Ihatetotank

Yes

AAndyProgram avatar Dec 04 '22 14:12 AAndyProgram

Fixed... Again... 😕 Please update to the latest release. 🎄 Happy new year! 🎄

AAndyProgram avatar Dec 26 '22 14:12 AAndyProgram