leboncoin-api icon indicating copy to clipboard operation
leboncoin-api copied to clipboard

Requests blocked due to security increase

Open xavierartot opened this issue 4 years ago • 9 comments

This is still possible to use your library to read the data’s?

xavierartot avatar Jun 06 '20 12:06 xavierartot

It depends of your "Production" and how many requests you plan to do.

tdurieux avatar Jun 07 '20 11:06 tdurieux

Hi,

What do you mean by "Production" ? I tried to use the api with the example in the readme and run it locally on my computer, I get a 403 error :/ Any way I can make this work ?

tagazok avatar Aug 31 '20 21:08 tagazok

I updated the user-agent used by the lib (v0.0.43), you should not get a 403 error now.

tdurieux avatar Sep 01 '20 09:09 tdurieux

Hello, I updated this package to 0.0.45 but I get a 403 error. Please help me.

[EDIT] I just tried it with a vpn and it works. I think "datadome" or "leboncoin" blocked my IP.

nFonsat avatar Sep 02 '20 06:09 nFonsat

They drastically increase security yesterday. I think it is the end of the lib :( The first request is generally not blocked but the second one is.

tdurieux avatar Sep 02 '20 06:09 tdurieux

I think so too :(. On their website, since yesterday, it is mandatory to validate a "captcha". Can we retrieve in another way their content as other very well known sites do?

nFonsat avatar Sep 02 '20 06:09 nFonsat

i am not aware of other ways

tdurieux avatar Sep 02 '20 07:09 tdurieux

They drastically increase security yesterday. I think it is the end of the lib :( The first request is generally not blocked but the second one is.

That was a great Journey :)

ronycohen avatar Nov 13 '20 17:11 ronycohen

What do you think about to leverage the community strength and crawl their site with micro, silenum based scrapers from many spots(every community member could launch one for 30 min a day) in order to grab, package and expose the data through a clean API?

victorbartel avatar Mar 11 '21 13:03 victorbartel