scrape-linkedin
scrape-linkedin copied to clipboard
Linkedin keeps blocking
Any recommendations to overcome? @ericfourrier
Any recommendations on this?
Also how to output the file to a json or html or php or what ever as i use -f and get nothing, then i get blocked...
you can output into json like following
import json from pylinkedin.scraper import LinkedinItem
l = LinkedinItem(url= str.strip(URL) )
l_json = json.dumps(l.to_dict())
out_filename = base_folder + str(emp_id) + '.json'
f = open(file=out_filename, mode="w")
f.write(l_json)
f.close()
Thanks
I've also got blocks by Linkedin. I managed to fix that by using https://proxycrawl.com/scraping-api-avoid-captchas-blocks which acts as middleware that I could use with this library. it also has this package https://github.com/proxycrawl/proxycrawl-python