scrapedin
scrapedin copied to clipboard
Show more button click overlaps with header
In some rare cases, when the planets align just the right way, Clicking the SHOW_MORE_ABOUT
button will actually redirect the page to LinkedIn jobs page.
In this case, this selector
{
id: 'SHOW_MORE_ABOUT',
selector: '#line-clamp-show-more-button'
}
Makes the browser click the following element
Which when is in puppeteer view, overlaps with the Jobs link on the header.
This redirects the whole page to https://www.linkedin.com/jobs/
which makes the whole scraping process fail since it can't find any selectors in the jobs page.