Scrapegraph-ai icon indicating copy to clipboard operation
Scrapegraph-ai copied to clipboard

Python scraper based on AI

Results 147 Scrapegraph-ai issues
Sort by recently updated
recently updated
newest added

**Is your feature request related to a problem? Please describe.** It is not possible to scrap site which requires authentication. **Describe the solution you'd like** Have an option to add...

david @ blackbox:Programming/searchgraphai $ python first_try.py Traceback (most recent call last): File "/home/david/.local/lib/python3.10/site-packages/langchain_core/output_parsers/json.py", line 66, in parse_result return parse_json_markdown(text) File "/home/david/.local/lib/python3.10/site-packages/langchain_core/utils/json.py", line 147, in parse_json_markdown return _parse_json(json_str, parser=parser) File "/home/david/.local/lib/python3.10/site-packages/langchain_core/utils/json.py",...

**Is your feature request related to a problem? Please describe.** Implement in a good way the deep search graph **Describe the solution you'd like**

enhancement
feature request

as they are the cheapest one pls add them

**Describe the bug** I generated a free Gemini key and found that its use was restricted, but I could obtain the information using the example given on the official website....

I have added support for Gemini Flash and Pro

Uses a virtually non-intrusive method to hide browser control features. Can bypass most human-authentication algorithms.

**Describe the bug:** I am trying to develop a web scraper on windows using streamlit and scrapegraph ai. It gives an error: 2024-05-19 12:12:07.798 Uncaught app exception Traceback (most recent...

**Is your feature request related to a problem? Please describe.** As openai & google api key cost money, it would be better if there's a way to run models directly...

``` from langchain_openai import AzureChatOpenAI from langchain_openai import AzureOpenAIEmbeddings import os llm_model_instance = AzureChatOpenAI( openai_api_version=os.environ["AZURE_OPENAI_API_VERSION"], azure_deployment=os.environ["AZURE_OPENAI_CHAT_DEPLOYMENT_NAME"], ) embedder_model_instance = AzureOpenAIEmbeddings( openai_api_version = os.environ["AZURE_OPENAI_API_VERSION"], azure_deployment=os.environ["AZURE_OPENAI_EMBEDDINGS_DEPLOYMENT_NAME"], ) graph_config = { "llm": {...