crawl4ai
crawl4ai copied to clipboard
unclecode
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
### crawl4ai version 0.6.0 with local build docker ### Expected Behavior When the number of program parameters increases, it should be able to display them all completely. ### Current Behavior...
## Summary fix typo of llm_config in LLMExtractionStrategy fix typo of LLMConfig in crawl4ai ## List of files changed and why llm-strategies.md ## How Has This Been Tested? YES. ##...
### crawl4ai version 0.6.0 ### Expected Behavior I can help to maintain the Documentation ### Current Behavior Some codes in the Documentation have bugs now, I have rewrite some codes...
## Summary Fix BFSDeepCrawlStrategy processing URLs that vary based on base domain or port so they only process once. The common case for this is [www.example.com](https://www.example.com/) vs [example.com](https://example.com/) but it...
### crawl4ai version 0.6.0 ### Expected Behavior markdown should contain the fit_markdown property ### Current Behavior I've recently upgraded to 0.6.0 from 0.4.xx and noticed that the markdown_v2 was deprecated...
### crawl4ai version 0.5.0.post8 ### Expected Behavior I am trying to crawl bscscan page. It should be able to wait for the Verifying if Human page, then scrape the page...
### crawl4ai version 0.6.2 ### Expected Behavior Js code should be executed by accepting cookies in page. ### Current Behavior 1. The crawler is failing to execute custom JavaScript injected...
### crawl4ai version 0.6.2 --- ### Expected Behavior The crawler should correctly resolve relative URLs based on the current page's location (e.g., appending relative paths to `https://example.com/release-notes/` rather than the...
### crawl4ai version 0.6.1 ### Expected Behavior The website https://www.gpc-tec.de redirects to https://www.gpc-tec.de/start.html . On this page the links are relative, eg. IMPRESSUM . Klicking on it leads to https://www.gpc-tec.de/impressum.html,...
### crawl4ai version 0.6.3 ### Expected Behavior should work on both Unix and Windows systems.  ### Current Behavior user cannot press 'q' to exit ### Is this reproducible? No...
