crawl4ai
crawl4ai copied to clipboard
README Example: CSS Selector Not Functioning
Description
I've identified an issue in the Advanced Usage example in the README.md file. The current CSS selector used for extracting content from the NBC News business page is not working as intended.
Current selector: "article.tease-card"
Issue: This selector fails to extract any data, making the example non-functional.
This problem may confuse new users trying to understand and implement the library's advanced features. Having a working example is important for demonstrating the correct usage of the crawler.
Expected Behavior
The example should successfully extract article descriptions from the NBC News business page.
Actual Behavior
No content is extracted, and the example fails to demonstrate the crawler's functionality.
Proposed Solution
I propose updating the CSS selector to ".wide-tease-item__description". This selector correctly targets the description text of the news articles.
Fix
I have created a pull request to address this issue: https://github.com/unclecode/crawl4ai/pull/135
Kindly review and merge of this pull request to resolve the issue.