scrapix
scrapix copied to clipboard
Create custom scraper
Currently there are 3 strategies
- default
- docssearch
- schema
They all answer to a certain common use case. We suppose these use-cases answer 90% of the website structures. Nonetheless, other app may not follow that structure or the user might want to only index a specific part of each page and not all of it.
For these cases, we want to create the possibility to provide a custom scraper.
A base to create the custom scraper was made but removed https://github.com/meilisearch/scrapix/blob/966675f368c6dc26a5f12ea36dde24bc2254a252/src/scrapers/custom.js#L1-L45
Nonetheless, it has been removed until we deem this feature necessary