typesense-docsearch-scraper
typesense-docsearch-scraper copied to clipboard
Allow mapping page addresses
Description
I need to index a site in my local environment. The site will be hosted on https://example.com/mySite, but I want to run scraper on my locally built and hosted copy, available under http://localhost. It would be great if the scraper could do the mapping and e.g. scrape content of http://localhost/foo.html and index it as found on https://example.com/mySite/foo.html, so I can use the built index in the TypeSense instance that https://example.com/mySite will be using in its search bar.