firecrawl icon indicating copy to clipboard operation
firecrawl copied to clipboard

Provide a capability to limit scapping depth of site

Open tractorjuice opened this issue 10 months ago • 0 comments

Enable a feature in the API to enable scrapping a certain depth of a site, for example:

https://www.mendable.ai/usecases/sales-enablement

Only scrape top level pages or xx deep.

tractorjuice avatar Apr 27 '24 10:04 tractorjuice