crawl4ai icon indicating copy to clipboard operation
crawl4ai copied to clipboard

[Bug]: Docker /crawl skip the content

Open RotEveryDay opened this issue 7 months ago • 3 comments

crawl4ai version

docker images unclecode/crawl4ai:0.6.0-rN

Expected Behavior

I hope to be able to scrape the title: "Product Safety Information Notice on a LED UV Nail Lamp sold on AliExpress", I can scrape it directly by calling arun(), but when using docker this content does not exist.

url:https://www.ccpc.ie/consumers/product_recalls/product-safety-information-notice-on-a-led-uv-nail-lamp-sold-on-aliexpress/

Current Behavior

no information about"Product Safety Information Notice on a LED UV Nail Lamp sold on AliExpress"

Is this reproducible?

Yes

Inputs Causing the Bug

curl -X POST http://localhost:11235/crawl \
  -H "Content-Type: application/json" \
  -d '{"urls":["https://www.ccpc.ie/consumers/product_recalls/product-safety-information-notice-on-a-led-uv-nail-lamp-sold-on-aliexpress/"],"crawler_config":{"type":"CrawlerRunConfig","params":{"scraping_strategy":{"type":"WebScrapingStrategy","params":{}},"exclude_social_media_domains":["facebook.com","twitter.com","x.com","linkedin.com","instagram.com","pinterest.com","tiktok.com","snapchat.com","reddit.com"]}}}'112

Steps to Reproduce


Code snippets


OS

Linux

Python version

as docker

Browser

Chrome

Browser version

No response

Error logs & Screenshots (if applicable)

No response

RotEveryDay avatar Apr 25 '25 02:04 RotEveryDay