Scrapegraph-ai
Scrapegraph-ai copied to clipboard
ScrapeGraphAI
Python scraper based on AI
**Describe the bug** FetchNode currently only fetches the static html content from the page and does not fetch any links. Without that multi-level scrapping won't be possible **To Reproduce** ```...
Tried litellm for hours but didn't work. Not so familiar with langchain. It would be better if some more examples (together_ai, openrouters) are provided. Customizable openai endpoint would be a...
Offer a node to scrape by taking a full-size image of the website and pass that through to a Vision Inference service. I've found that this solution results in a...
Hey Folks, this looks like a great project. I am not sure if its a bug or a feature. **Describe the bug** > Executes the node's logic to instantiate and...
Ciao! Congrats for the growth. Now that many more people will be using scrapegraph, I would recommend to switch from poetry to another package manager. Poetry has two not-so-great features:...
These are follow-up changes from the discussion https://github.com/VinciGit00/Scrapegraph-ai/issues/187 We are now adding a mechanism to fetch the contents of the webpage using beautifulsoup. Apart from the header and body are...
Hey :wave: LocalAI (https://github.com/mudler/LocalAI) author here - nice project! **Is your feature request related to a problem? Please describe.** I'd like to run this locally with LocalAI - only Ollama...
**Describe the bug** When run the library with langserve, it shows error as below: ``` ERROR: Exception in ASGI application RuntimeError: super(): __class__ cell not found The above exception was...
**Describe the bug** pip install scrapegraphai throws error AttributeError: module 'pkgutil' has no attribute 'ImpImporter'. Did you mean: 'zipimporter'? [end of output] note: This error originates from a subprocess, and...
Created a fix that allows examples/openai/script_generator_openai.py to run successfully. I made 3 major changes: 1. Added a new parameter "parse_html" to the node_config for ParseNode. If set to False it...
