gpt4all icon indicating copy to clipboard operation
gpt4all copied to clipboard

Published 20 hours ago • verified publisher icon nomic-ai

Upstage Solar Pro Preview model is incoherent

Open brankoradovanovic-mcom opened this issue 5 months ago • 0 comments

When trying to use Solar Pro Preview (Maziyar Panahi's Q5_K_M GGUF), I'm largely getting incoherent responses: image

Whether this is a problem with the GGUF or the inference logic is off, I can't tell. Anyone with a similar experience?

Your Environment

  • GPT4All version: 3.2.1
  • Operating System: Windows 10
  • Chat model used (if applicable): https://huggingface.co/MaziyarPanahi/solar-pro-preview-instruct-GGUF/blob/main/solar-pro-preview-instruct.Q5_K_M.gguf

brankoradovanovic-mcom avatar Sep 16 '24 08:09 brankoradovanovic-mcom