linvo-scraper icon indicating copy to clipboard operation
linvo-scraper copied to clipboard

[DOCS] Add URL examples for scraping services

Open TheOtherBrian1 opened this issue 2 years ago • 3 comments

Description

I have been trying to use Linvo's scraping library found in the linkedin.global.page.service.ts . Unfortunately, in the required parameters section it doesn't specify which URLs are acceptable for scraping.

interface RequiredData {
  page: number;
  url: string; //WHAT DOES THE URL LOOK LIKE
  remove_overlapping: boolean;
}

It would be very helpful to provide one or more of the following:

  • TypeScript URL checking
  • A descriptive URL related comment in the linkedin.global.page.service.ts file
  • A descriptive error message that outlines which webpages are appropriate
  • Documentation that specifies which webpages can be scraped

Right now, when I provide the following URL as an argument

https://www.linkedin.com/search/results/all/?keywords=DATA%20SCIENCE%20JOBS&origin=GLOBAL_SEARCH_HEADER&sid=Q~M

I receive the warning:

originalMessage: 'Cannot navigate to invalid URL'

Unfortunately, for less experienced users like myself, this error message is not informative enough to be actionable.

TheOtherBrian1 avatar Oct 10 '22 20:10 TheOtherBrian1

Yes, it has to be with "https://www.linkedin.com/search/results/people/" can you add it to the docs?

nevo-david avatar Oct 11 '22 03:10 nevo-david

Yeah, I can add it. I can work on creating a tutorials/examples section

TheOtherBrian1 avatar Oct 11 '22 03:10 TheOtherBrian1

Awsome! Assigning it to you!

nevo-david avatar Oct 11 '22 05:10 nevo-david