crawl4ai icon indicating copy to clipboard operation
crawl4ai copied to clipboard

[Bug]: using openrouter hangs the applicaion

Open jasonmhead opened this issue 6 months ago • 4 comments

crawl4ai version

current as of 5-15-2025 - pip install

Expected Behavior

trying to use openrouter for processing

Current Behavior

trying to use openrouter and the application hangs Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new LiteLLM.Info: If you need to debug this error, use `litellm._turn_on_debug()'.

extraction_strategy=LLMExtractionStrategy( llm_config=LLMConfig( provider="openrouter/google/gemini-2.5-pro-exp-03-25", api_token=os.getenv('OPENROUTER_API_KEY') ), schema=SearchResult.schema(), extraction_type="schema",

Is this reproducible?

Yes

Inputs Causing the Bug

extraction_strategy=LLMExtractionStrategy(
            llm_config=LLMConfig(
                provider="openrouter/google/gemini-2.5-pro-exp-03-25",
                api_token=os.getenv('OPENROUTER_API_KEY')
            ),
            schema=SearchResult.schema(),
            extraction_type="schema",

Steps to Reproduce

extraction_strategy=LLMExtractionStrategy(
            llm_config=LLMConfig(
                provider="openrouter/google/gemini-2.5-pro-exp-03-25",
                api_token=os.getenv('OPENROUTER_API_KEY')
            ),
            schema=SearchResult.schema(),
            extraction_type="schema",

and run

Code snippets


OS

windows 10

Python version

3.10

Browser

default config

Browser version

default config=browser_config

Error logs & Screenshots (if applicable)

No response

jasonmhead avatar May 14 '25 18:05 jasonmhead

i dunno im askin myself that question too

Juoelenis avatar May 13 '25 18:05 Juoelenis

I think hirens pe is quite large. Maybe 4gb ram ( which may be 3gb usable ram) is too small Ventoy takes up memory when loaded. Maybe find the smallest version of hbcdpe and test?

steve6375 avatar May 13 '25 19:05 steve6375

I think hirens pe is quite large. Maybe 4gb ram ( which may be 3gb usable ram) is too small Ventoy takes up memory when loaded. Maybe find the smallest version of hbcdpe and test?

Hello!

All the HBCD-PE releases I could find are:

  • 1.0.1: 1.3 GB
  • 1.0.2: 2.9 GB
  • 1.0.8: 3.06 GB
  • beta: 3.6 GB

All are here or here, and I tested all of them and any of them have worked (I didn't test newer versions of Ventoy).

There are other distributions based of WinPE what are safe and free?

LukasThyWalls avatar May 13 '25 21:05 LukasThyWalls

https://thedoggybrad.github.io/WindowsPEBasicEnhanced/

steve6375 avatar May 14 '25 07:05 steve6375

Image

steve6375 avatar May 14 '25 07:05 steve6375

There are other distributions based of WinPE what are safe and free?

The German Magazin c't has this project. https://www.heise.de/ratgeber/c-t-Notfall-Windows-2025-10091707.html You can make, customize, your own PE image.

I use it with ventoy and have no problems

Conan179 avatar May 14 '25 08:05 Conan179

Take me a while to do some proper testing, and then I didn't wanted to revamp this issue to only update the info, but better put everything there and left it behind.

There are other distributions based of WinPE what are safe and free?

The German Magazin c't has this project. https://www.heise.de/ratgeber/c-t-Notfall-Windows-2025-10091707.html You can make, customize, your own PE image.

I use it with ventoy and have no problems

I tried that and It doesn't work, but for sure It is because for the laptop, because It doesn't work with Ventoy or Rufus. The thing is It tries to load it but It hangs a while after. With the HBCD-PE releases that I tried, It goes directly to a blinking cursor and nothing more.

So something is different with those HBCD-PE releases and this laptop.

Anyway, this laptop is very old, and If I need to do something with it I will try what works. I don't think It's worth it to look up more with it, especially If It's only me with this old laptop the one with the issue.

I'm going to close this issue, but to be noted that still happens.

Thanks anyway!

LukasThyWalls avatar Jul 19 '25 18:07 LukasThyWalls