crawl4ai icon indicating copy to clipboard operation
crawl4ai copied to clipboard

README Example: CSS Selector Not Functioning

Open hitesh22rana opened this issue 1 year ago • 0 comments

Description

I've identified an issue in the Advanced Usage example in the README.md file. The current CSS selector used for extracting content from the NBC News business page is not working as intended.

Current selector: "article.tease-card" Issue: This selector fails to extract any data, making the example non-functional. This problem may confuse new users trying to understand and implement the library's advanced features. Having a working example is important for demonstrating the correct usage of the crawler.

Expected Behavior

The example should successfully extract article descriptions from the NBC News business page.

Actual Behavior

No content is extracted, and the example fails to demonstrate the crawler's functionality.

Proposed Solution

I propose updating the CSS selector to ".wide-tease-item__description". This selector correctly targets the description text of the news articles.

Fix

I have created a pull request to address this issue: https://github.com/unclecode/crawl4ai/pull/135

Kindly review and merge of this pull request to resolve the issue.

hitesh22rana avatar Oct 09 '24 14:10 hitesh22rana