scrapix icon indicating copy to clipboard operation
scrapix copied to clipboard

Create custom scraper

Open bidoubiwa opened this issue 1 year ago • 0 comments

Currently there are 3 strategies

  • default
  • docssearch
  • schema

They all answer to a certain common use case. We suppose these use-cases answer 90% of the website structures. Nonetheless, other app may not follow that structure or the user might want to only index a specific part of each page and not all of it.

For these cases, we want to create the possibility to provide a custom scraper.

A base to create the custom scraper was made but removed https://github.com/meilisearch/scrapix/blob/966675f368c6dc26a5f12ea36dde24bc2254a252/src/scrapers/custom.js#L1-L45

Nonetheless, it has been removed until we deem this feature necessary

bidoubiwa avatar Jun 20 '23 11:06 bidoubiwa