Scrapegraph-ai
Scrapegraph-ai copied to clipboard
ScrapeGraphAI
Python scraper based on AI
**Is your feature request related to a problem? Please describe.** A scraper pipeline capable of retrieve all the similar blocks in a page, like ecommerce, weather, fly websites **Describe the...
**Is your feature request related to a problem? Please describe.** I am a aws bedrock user and interested in integrating ScrapeGraph with aws Bedrock models ecosystem. **Describe the solution you'd...
**Describe the bug** keep getting insufficient_quota when testing with google colab. **To Reproduce** run the colab example **Expected behavior** it is probably rate limiting because it is trying to call...
**Is your feature request related to a problem? Please describe.** Difficulty to understand how it works under the lines and how it is structured **Describe the solution you'd like** A...
**Is your feature request related to a problem? Please describe.** Change proxy rotation function
**Is your feature request related to a problem? Please describe.** I'd like to scrape a website n-levels deep. **Describe the solution you'd like** For example, given url = example.com, the...
### Description: Building on our graph visualization capabilities, we aim to develop a feature that allows the creation of scraping class structures from Graphviz diagrams. This will enable rapid prototyping...
It would be great to receive the actual node structure along with the json. I am scraping the same website for different products, If I get the actual nodes for...
Description The ScriptCreatorGraph will fail to produce a useful script under any circumstances. Steps to reproduce the behavior: 1. Run examples/openai/script_generator_openai.py 2. Examine and attempt to run the produced script...
based on this code: from scrapegraphai.graphs.pdf_scraper_graph import PDFScraperGraph from scrapegraphai.utils import prettify_exec_info OPENAI_API_KEY = "sk-" graph_config = {"llm": {"api_key": OPENAI_API_KEY, "model": "gpt-3.5-turbo"}} smart_scraper_graph = PDFScraperGraph( "List me scope 1 emissions...
