Archon icon indicating copy to clipboard operation
Archon copied to clipboard
verified publisher icon coleam00

Feature request: Support for scraping instructions

Open gideoncatz opened this issue 3 months ago • 2 comments

When scraping for documentation, it would be awesome to be able to provide specific instructions for scraping. For example, from the site https://reactnative.dev/sitemap.xml I want to scrape documentation only for version 0.8 Thanks

gideoncatz avatar Sep 02 '25 14:09 gideoncatz

I appreciate the feature request! This would definitely be possible with some of the LLM integrations that Crawl4AI has added in recently for intelligent crawling.

coleam00 avatar Sep 06 '25 18:09 coleam00

Sounds cool, thanks Cole!

I appreciate the feature request! This would definitely be possible with some of the LLM integrations that Crawl4AI has added in recently for intelligent crawling.

gideoncatz avatar Sep 06 '25 20:09 gideoncatz

adding this to a feature request discussion, seems like a very reasonable feature that needs to be scoped

Wirasm avatar Sep 18 '25 10:09 Wirasm