scrapedin-linkedin-crawler
scrapedin-linkedin-crawler copied to clipboard
linkedtales
Scrape company employees
Is possible to retrieve users (and then scrape their profiles) from company url?
Given a company url : https://www.linkedin.com/company/mycompany
We can have a list of employees scraping : https://www.linkedin.com/company/mycompany/people/
There is any built-in functionality to achieve this or should i implement this by myself?
@nicosh no, currently we don't have this feature, but we're glad about receiving such contribution :smile:
this feature was already asked on scrapedin, see here , please read my comment about how this could be implemented, thank you!
Hey,
As mentioned by @a10kiloham. I do want to work on Company data scrapper.
When I submit Company URL instead of the user Profile URL, the scrapper should go to the Company page then click on see all employees and then it will see all employee data.
- It should click on each employee and fetch data from the profile as we already do (one by one operation).
- Then, it should click on view more and continue its operation
Attached file for Step 1
Scrapper should repeat it's operation.
As you mentioned above, I tried Creating companyScrapperTemplate for Step 1 and created click functionality and see more functionality in those relative files.
But it does not seem to be working. Made required changes in other files but still the same.
@gigaBITE397 There is no need to scrape each Linkedin employee profile. Here is a really simple example on how you can scrape employees data from Company profile page.
I do alot of LinkedIn scraping for company's employees as well but find it quite difficult running a scrapper due to the limitation in volume. I'm embarrassed to say but i ultimately gave up and resorted to a paid service, Mantheos which has an API that allows me to extract LinkedIn profile data at mass. Sharing here in case anyone requires something like this.
@nicosh I tried your method too, but using a voyager path means going through LinkedIn official APIs. I don't want to use that. I want to implement in the same way as we do for the contacts extraction. As @leonardiwagner said, I tried creating profile.js for the company too. But it's not working either.
