scrape-linkedin-selenium
scrape-linkedin-selenium copied to clipboard
Companyscraper doesn't work and returns error 'NoneType'
unable to get the company website
Company Attrs: ['overview', 'jobs', 'life', 'insights']
Error!!!
Traceback (most recent call last):
File "linkedin_scrapper_chrome.py", line 72, in
Hi @austinoboyle,
Found that there is no .error-container selector is no more on LinkedIn but using CSS selector in companyscrapper.py
load_initial() function
EC.presence_of_element_located
(By.CSS_SELECTOR, '.error-container'))
Also, from get_overview function, the following attribute is unavailable from the UI
tab_link = self.driver.find_element_by_css_selector(
'a[data-control-name="page_member_main_nav_about_tab"]')
Hi, I have the same issue -- I get the message:
Traceback (most recent call last):
File "<stdin>", line 3, in <module>
File "/Users/eunhousong/anaconda3/lib/python3.7/site-packages/scrape_linkedin/ResultsObject.py", line 13, in to_dict
return dict(zip(self.attributes, vals))
File "/Users/eunhousong/anaconda3/lib/python3.7/site-packages/scrape_linkedin/ResultsObject.py", line 12, in <lambda>
vals = map(lambda attr: getattr(self, attr), self.attributes)
File "/Users/eunhousong/anaconda3/lib/python3.7/site-packages/scrape_linkedin/Company.py", line 34, in overview
overview['description'] = container.select_one(
AttributeError: 'NoneType' object has no attribute 'select_one'
Yes, this is due to a change in the LinkedIn UI. This happens once fairly frequently, and it's difficult to keep up. If you have a fix for the issue, I would be happy to approve a pull request.
Hello Sir I would like to contribute to this issue
Hello Sir, I've left a pull request for this issue, please look into it.