url-metadata icon indicating copy to clipboard operation
url-metadata copied to clipboard

Redirect / short URLs not working

Open alexpluto opened this issue 4 years ago • 5 comments

Only certain short URLs that redirect are supported where meta data is returned.

e.g. https://abnb.me/fHw1T5PE68 - this is not working and no meaningful meta data is returned. When using this URL in: https://developers.facebook.com/tools/debug/ - you can see the meta data that should be returned after the redirect

e.g. https://bit.ly/322JENd - this is working as expected and returns meta data from the redirected URL.

alexpluto avatar Aug 25 '20 11:08 alexpluto

@laurengarcia @suchtomwow @czarandy @ITJesse Hi all, just wondering if you ever had a chance to see this?

alexpluto avatar May 25 '21 15:05 alexpluto

@alexpluto did you find a solution for this, I am also facing this issue

abhi31AI avatar Mar 02 '22 10:03 abhi31AI

@abhi31AI unfortunately not :(

alexpluto avatar Mar 02 '22 11:03 alexpluto

@alexpluto do you know any other alternatives to bring out the metadata from the url.

Actually URLs that I am working on, twitter, fb and linkedIn are able to get those metadata out but I am not able to do it in my web application with the given npm package

abhi31AI avatar Mar 02 '22 11:03 abhi31AI

@abhi31AI unfortunately we paused investigating this further. Would love to hear if you're able to solve this!

alexpluto avatar Mar 02 '22 12:03 alexpluto

Looked into this, it seems there is an issue with https://abnb.me/fHw1T5PE68 where there is an intermediary hop in the request forwarding chain. The final hop where it gets stuck is: https://bnc.lt/m/fHw1T5PE68?_p=c61229c59b1c65f0e6038ffce9. There is no issue with the forwarding when i make the request through a browser so it may have to do with certain request headers (some companies block scraping from their front ends).

With the new version of url-metadata version 3.0.1 you may be able to use the custom requestHeaders option to get around this.

laurengarcia avatar Apr 18 '23 19:04 laurengarcia