llm-answer-engine icon indicating copy to clipboard operation
llm-answer-engine copied to clipboard

Published 20 hours ago • verified publisher icon developersdigest

ollama interface problem

Open iplayfast opened this issue 3 months ago • 3 comments 

 ✓ Ready in 667ms
 ○ Compiling / ...
 ✓ Compiled / in 1628ms (1571 modules)
 ✓ Compiled in 293ms (470 modules)
There was a problem with your fetch operation: [Error: Network response was not ok. Status: 422]
Error: Network response was not ok. Status: 422
    at getImages (webpack-internal:///(rsc)/./app/action.tsx:178:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Promise.all (index 0)
    at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
Error: Network response was not ok. Status: 422
    at getImages (webpack-internal:///(rsc)/./app/action.tsx:178:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Promise.all (index 0)
    at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
 ⨯ unhandledRejection: Error: Network response was not ok. Status: 422
    at getImages (webpack-internal:///(rsc)/./app/action.tsx:178:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Promise.all (index 0)
    at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
 ⨯ unhandledRejection: Error: Network response was not ok. Status: 422
    at getImages (webpack-internal:///(rsc)/./app/action.tsx:178:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Promise.all (index 0)
    at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
Error fetching search results: [Error: HTTP error! status: 422]
Error fetching videos: [Error: Network response was not ok. Status: 403]
The streamable UI has been slow to update. This may be a bug or a performance issue or you forgot to call `.done()`.

app/config.tsx

// - The below are going to be the default values, eventually this will move to a UI component so it can be easily changed by the user
// - To enable + use Ollama models, ensure inference and/or embeddings model are downloaded and ollama is running https://ollama.com/library 
// - Icons within UI are not yet dynamic, to change currently, you must change the img src path in the UI component
// - IMPORTANT: when Ollama Embeddings + Ollama inference enabled at the same time, this can cause time-to-first-token to be quite long
// - IMPORTANT: Follow-up questions are not yet implrmented with Ollama models, only OpenAI compatible models that use  {type: "json_object"}

export const config = {
    useOllamaInference: true, 
    useOllamaEmbeddings: true, 
    inferenceModel: 'mistral', //mixtral-8x7b-32768', // Groq: 'mixtral-8x7b-32768', 'gemma-7b-it' // OpenAI: 'gpt-3.5-turbo', 'gpt-4' // Ollama 'mistral', 'lla
ma2' etc
    inferenceAPIKey: process.env.GROQ_API_KEY, // Groq: process.env.GROQ_API_KEY // OpenAI: process.env.OPENAI_API_KEY // Ollama: 'ollama' is the default
    embeddingsModel: 'llama2', // Ollama: 'llama2', 'nomic-embed-text' // OpenAI 'text-embedding-3-small', 'text-embedding-3-large'
    textChunkSize: 500, // Recommended to decrease for Ollama
    textChunkOverlap: 200, // Recommended to decrease for Ollama
    numberOfSimilarityResults: 4, // Numbher of similarity results to return per page
    numberOfPagesToScan: 5, // Recommended to decrease for Ollama
    nonOllamaBaseURL: 'https://api.groq.com/openai/v1', //Groq: https://api.groq.com/openai/v1 // OpenAI: https://api.openai.com/v1 
};

iplayfast avatar Mar 28 '24 16:03 iplayfast

I'm getting something a little similar:

(base) arw@AIMonster:/mnt/e/AI_Directories/llm-answer-engine$ npm run dev

[email protected] dev next dev

▲ Next.js 14.1.2

  • Local: http://localhost:3000
  • Environments: .env

✓ Ready in 1690ms ○ Compiling / ... ✓ Compiled / in 3s (1588 modules) ✓ Compiled in 217ms (470 modules) Error fetching videos: [Error: Network response was not ok. Status: 403] Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) ⨯ unhandledRejection: Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) ⨯ unhandledRejection: Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) The streamable UI has been slow to update. This may be a bug or a performance issue or you forgot to call .done(). ...

app/config is the default, and I have all api keys (brave, openai, groq, serper)

noodleA1 avatar Mar 29 '24 04:03 noodleA1

running a different search, this came up with a few different errors. yes...yes, I searched up kiwis

▲ Next.js 14.1.2

  • Local: http://localhost:3000
  • Environments: .env

✓ Ready in 1743ms ○ Compiling / ... ✓ Compiled / in 1494ms (1570 modules) ✓ Compiled in 457ms (470 modules) Error fetching videos: [Error: Network response was not ok. Status: 403] Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) ⨯ unhandledRejection: Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) ⨯ unhandledRejection: Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) Error fetching image link https://plantinstructions.com/wp-content/uploads/2017/03/kiwi-in-a-pot.jpg: [TypeError: fetch failed] { cause: [Error: redirect count exceeded] } Error fetching image link https://plantinstructions.com/wp-content/uploads/2017/03/kiwi-plant.jpg: [TypeError: fetch failed] { cause: [Error: redirect count exceeded] } The streamable UI has been slow to update. This may be a bug or a performance issue or you forgot to call .done().

noodleA1 avatar Mar 29 '24 04:03 noodleA1

Another attempt after uninstalling node/npm ... (base) arw@AIMonster:/mnt/e/AI_Directories/llm-answer-engine$ npm run dev

[email protected] dev next dev

▲ Next.js 14.1.2

  • Local: http://localhost:3000
  • Environments: .env

✓ Ready in 13.7s ○ Compiling / ... ✓ Compiled / in 14.1s (1588 modules) ✓ Compiled in 334ms (470 modules) Error fetching videos: [Error: Network response was not ok. Status: 403] Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) ⨯ unhandledRejection: Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) ⨯ unhandledRejection: Error: Network response was not ok. Status: 403 at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Promise.all (index 2) at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43) Error fetching image link https://s3g2u3k4.rocketcdn.me/wp-content/uploads/sites/4/2022/03/kiwi.jpg: [TypeError: fetch failed] { cause: [Error: getaddrinfo ENOTFOUND s3g2u3k4.rocketcdn.me] { errno: -3008, code: 'ENOTFOUND', syscall: 'getaddrinfo', hostname: 's3g2u3k4.rocketcdn.me' } } Error fetching image link https://plantinstructions.com/wp-content/uploads/2017/03/kiwi-in-a-pot.jpg: [TypeError: fetch failed] { cause: [Error: redirect count exceeded] } Error fetching image link https://plantinstructions.com/wp-content/uploads/2017/03/kiwi-plant.jpg: [TypeError: fetch failed] { cause: [Error: redirect count exceeded] } The streamable UI has been slow to update. This may be a bug or a performance issue or you forgot to call .done().

noodleA1 avatar Mar 29 '24 05:03 noodleA1