crawl4ai

crawl4ai copied to clipboard

[Bug]: cannot crawl all content while scan_full_page=True

1

### crawl4ai version 0.5.0.post8 ### Expected Behavior get all note-item content when scroll to the last page ### Current Behavior only obtain the content of the note-item class on the...

duanyr

## Summary Simply fixing a typo ("temprature" vs "temperature") found in the LLMConfig class. These changes seek to align the spelling with what is generally expected in LiteLLM's [documentation](https://docs.litellm.ai/docs/). This...

mvdmakesthings

## Summary Please include a summary of the change and/or which issues are fixed. Fixes #1082 https://github.com/unclecode/crawl4ai/discussions/1082 ## List of files changed and why All files related with api_key_env, adding...

Sacristaan

Fix warning as proposed by bs4: ``` .../bs4/element.py:2253: DeprecationWarning: The 'text' argument to find()-type methods is deprecated. Use 'string' instead. return self.find_all( ``` ## Summary Please include a summary of...

RoyLeviLangware

Pardon the PR w/out a corresponding Issue -- I hacked together these changes to scratch my own itch for a project I started this evening, and figured I'd throw up...

jeremygiberson

### crawl4ai version 0.6.2 ### Expected Behavior Crawling the internal links until the depth specified, with a maximum of pages (specified as well), in DFS mode. ### Current Behavior Only...

margauxallee

[Bug]: Deep crawling is stuck after 2 pages

2

### crawl4ai version 0.5.0.post8 ### Expected Behavior The crawler needs to timeout or continue crawling. ### Current Behavior I am using the code from the docs https://docs.crawl4ai.com/core/deep-crawling/ But I cannot...

dmitriibeliakov

[Bug]: css_selector can only select the first class in the page

1

### crawl4ai version Version: 0.5.0.post8 ### Expected Behavior # CSS Selector Example async def simple_example_with_css_selector(): print("\n--- Using CSS Selectors ---") browser_config = BrowserConfig(headless=True) crawler_config = CrawlerRunConfig( cache_mode=CacheMode.BYPASS, css_selector="li.CommitRow-module__ListItem_0--PkFAi h4" )...

zhongxinlei

This PR updates references to deprecated Groq LLM models with their recommended replacements as documented in Groq's deprecation notice: https://console.groq.com/docs/deprecations#deprecation-history Changes Updated deprecated llama3-70b-8192 and llama3-8b-8192 models to use the...

mccullya

[Bug]: Random user agent not closing browser?

1

### crawl4ai version 0.6.1 ### Expected Behavior having issues with user_agent_mode = "random". Here is what I have in the playground for the URL example.com. I'm starting to think I...

digiSal