crawl4ai
crawl4ai copied to clipboard
unclecode
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
### crawl4ai version 0.6.0 ### Expected Behavior I run cli command crwl "https://htreviews.org/tobaccos/darkside" -o md -c scan_full_page=True,scroll_delay=0.5,delay_before_return_html=2 I expect it to scan full page ### Current Behavior It doesn't scan...
## Summary ### Before fix the issue  ### After fixed the issue 
## Summary Fix [#1057](https://github.com/unclecode/crawl4ai/issues/1057)
### crawl4ai version 0.5.0 ### Expected Behavior This website does not have an href address and needs to be crawled in the next step ### Current Behavior Currently unable to...
### crawl4ai version playwright==1.51.0 ### Expected Behavior  ### Current Behavior unable to install the winldd it just return nothing when i run the provided command! ### Is this reproducible?...
### crawl4ai version docker images unclecode/crawl4ai:0.6.0-rN ### Expected Behavior I hope to be able to scrape the title: "Product Safety Information Notice on a LED UV Nail Lamp sold on...
### crawl4ai version 6 ### Expected Behavior Requesting a google search url, example: https://www.google.com/search?q=hotel, I want to be able to retrieve the different domains present on the page and the...
### crawl4ai version 0.6.0 ### Expected Behavior If I set custom config options and then switch to another config type and back, the options I added are removed ### Current...
### crawl4ai version 0.6.1 ### Expected Behavior When `AsyncWebCrawler` is initialized with `headless=False` (either via `BrowserConfig` or directly as a constructor parameter), a visible browser window (e.g., Chromium) is expected...
### crawl4ai version 0.6.0 with local build docker ### Expected Behavior Select `LLMConfig` from the Advanced Config dropdown menu and fill in the parameters. ### Current Behavior Currently, only `CrawlerRunConfig`...
