scrape-linkedin icon indicating copy to clipboard operation
scrape-linkedin copied to clipboard

Linkedin keeps blocking

Open ceased-ebc opened this issue 7 years ago • 4 comments

Any recommendations to overcome? @ericfourrier

ceased-ebc avatar Aug 23 '17 12:08 ceased-ebc

Any recommendations on this?

Also how to output the file to a json or html or php or what ever as i use -f and get nothing, then i get blocked...

ceased-ebc avatar Aug 24 '17 07:08 ceased-ebc

you can output into json like following

import json from pylinkedin.scraper import LinkedinItem

l = LinkedinItem(url= str.strip(URL) ) l_json = json.dumps(l.to_dict()) out_filename = base_folder + str(emp_id) + '.json'
f = open(file=out_filename, mode="w") f.write(l_json) f.close()

afrozhussain avatar Sep 16 '17 19:09 afrozhussain

Thanks

ceased-ebc avatar Sep 16 '17 22:09 ceased-ebc

I've also got blocks by Linkedin. I managed to fix that by using https://proxycrawl.com/scraping-api-avoid-captchas-blocks which acts as middleware that I could use with this library. it also has this package https://github.com/proxycrawl/proxycrawl-python

rochenka avatar Jan 02 '19 10:01 rochenka