crawl4ai icon indicating copy to clipboard operation
crawl4ai copied to clipboard

Quick Start cant run

Open BaoTan opened this issue 1 year ago β€’ 10 comments

Traceback (most recent call last): File "/home/paco/work_prjs/my_prjs/scrawler_xjp/main.py", line 11, in asyncio.run(main()) File "/home/paco/work_envs/dl_env/miniconda3/lib/python3.9/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/home/paco/work_envs/dl_env/miniconda3/lib/python3.9/asyncio/base_events.py", line 642, in run_until_complete return future.result() File "/home/paco/work_prjs/my_prjs/scrawler_xjp/main.py", line 6, in main result = await crawler.arun(url="https://www.nbcnews.com/business") File "/home/paco/work_envs/dl_env/miniconda3/lib/python3.9/site-packages/crawl4ai/async_webcrawler.py", line 185, in arun async with self._lock or nullcontext(): AttributeError: aenter

BaoTan avatar Dec 11 '24 15:12 BaoTan

I have just installed CrawlAi. I ran the test example and had similar error.

Aclavelar avatar Dec 11 '24 22:12 Aclavelar

I'm getting unhashable Error, there was no problem before v.4 [FETCH]... ↓ https://www.tapflo.com.pl/pompy-membranowe/seria-p... | Status: True | Time: 3.38s [ERROR]... Γ— https://www.tapflo.com.pl/pompy-membranowe/seria-p... | Error: β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ Γ— Process HTML, Failed to extract content from the website: β”‚ β”‚ https://www.tapflo.com.pl/pompy-membranowe/seria-pe-i-ptfe, error: β”‚ β”‚ unhashable type: 'list' β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

deltacodepl avatar Dec 12 '24 07:12 deltacodepl

I have the following error as shown below:

[ERROR]... Γ— https://www.nbcnews.com/business... | Error: β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ Γ— async_crawler_strategy.py:_crawleb(): Timeout 30000ms exceeded. β”‚ β”‚ =========================== logs =========================== β”‚ β”‚ "load" event fired β”‚ β”‚ ============================================================ β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Themisstone avatar Dec 12 '24 09:12 Themisstone

Same here as well!

makispl avatar Dec 12 '24 11:12 makispl

Hey everyone

@BaoTan @Aclavelar Please update again to ~0.4.21 in 2 - 3 hours and let me know please.~ 0.4.22 and let me know please.

@deltacodepl @Themisstone @makispl Can you share your code snippet

unclecode avatar Dec 13 '24 12:12 unclecode

Hi Hossein,

the script is the one attached (similar to the one I recently sent you to help me with extracting pricing plans and filtering features per tier). The issue is very rare, I have to admit.

In the meantime, I've created issueΒ #349 [https://github.com/unclecode/crawl4ai/issues/349] regarding the deployment of my custom tool on crewai+ enterprise platform. I’d really appreciate it if you could help me with that.

I acknowledge that I’ve asked a lot, but I’ve tried a dozen of scrapers out there and crawl4AI is by far the best! My product deeply relies on this, I really need to overcome this issue πŸ™πŸΌ

Warm regards,

Ger On 13 Dec 2024 at 2:46β€―PM +0200, UncleCode @.***>, wrote:

Hey everyone @BaoTan @Aclavelar Please update again to 0.4.21 in 2 - 3 hours and let me know please. @deltacodepl @Themisstone @makispl Can you share your code snippet β€” Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

makispl avatar Dec 14 '24 10:12 makispl

Everyone please make sure to upgrade to 0.4.22 @BaoTan @deltacodepl @makispl @Aclavelar

unclecode avatar Dec 16 '24 07:12 unclecode

Hi Hossein, the script is the one attached (similar to the one I recently sent you to help me with extracting pricing plans and filtering features per tier). The issue is very rare, I have to admit. In the meantime, I've created issueΒ #349 [#349] regarding the deployment of my custom tool on crewai+ enterprise platform. I’d really appreciate it if you could help me with that. I acknowledge that I’ve asked a lot, but I’ve tried a dozen of scrapers out there and crawl4AI is by far the best! My product deeply relies on this, I really need to overcome this issue πŸ™πŸΌ Warm regards, Ger … On 13 Dec 2024 at 2:46β€―PM +0200, UncleCode @.>, wrote: Hey everyone @BaoTan @Aclavelar Please update again to 0.4.21 in 2 - 3 hours and let me know please. @deltacodepl @Themisstone @makispl Can you share your code snippet β€” Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.>

Hi Ger, I will check your code very soon, hopefully today or tomorrow. I hope we can wrap it up and have a good example of Crawl4ai in our docs.

unclecode avatar Dec 16 '24 07:12 unclecode

Everyone please make sure to upgrade to 0.4.22 @BaoTan @deltacodepl @makispl @Aclavelar

Hi

It is working now!

Thanks!!!

Aclavelar avatar Dec 16 '24 18:12 Aclavelar

You're welcome, please make sure to upgrade to 0.4.23 as well.

unclecode avatar Dec 17 '24 08:12 unclecode