openui icon indicating copy to clipboard operation
openui copied to clipboard

The last PR broke Ollama local model selection.

Open clementvp opened this issue 9 months ago • 12 comments

I've pull the newest version -> https://github.com/wandb/openui/commit/6f4a26dbadb5674ff825bb26f6f745fa57cd223f

I've resinstall the backend and set a Groq api key, but in the model selection dropwdown I just got OpenAi models.

No more Ollama locals models ( the previous version had that). ( Ollama running on my computer) And no possibility to choose a groq model.

image

with commit 3fc829be3e30aa8caf8aaa902136cc333c75ea21:

image

clementvp avatar May 13 '24 16:05 clementvp

same problem here

kakachiex2 avatar May 14 '24 03:05 kakachiex2

Is there any way to solve it, Or not yet

Abdulkader-Safi avatar May 14 '24 06:05 Abdulkader-Safi

I think its some problem in the UI, as the API is listing the groq models perfectly.

omkargadute avatar May 14 '24 07:05 omkargadute

Is there any way to solve it, Or not yet

I have rollback to the previous commit ( but no grog support ).

clementvp avatar May 14 '24 08:05 clementvp

@tlo9 @vanpelt Do you run on this issue too ? Are we missing something ? Thx again for the PR and the project :)

clementvp avatar May 14 '24 08:05 clementvp

You need to build the frontend manually for now

cd frontend
pnpm i
npm run deploy
npm run postbuild

Restart your container/app

dbian avatar May 14 '24 12:05 dbian

Can confirm that @dbian solution works on my machine and I can finally use local models.

niktekusho avatar May 14 '24 13:05 niktekusho

I confirm that work 👍 thx @dbian

clementvp avatar May 14 '24 13:05 clementvp

Legend! @dbian

Screenshot

image

DiazMichael avatar May 14 '24 20:05 DiazMichael

@dbian this process doesn't work for me I'm on windows 11

kakachiex2 avatar May 15 '24 01:05 kakachiex2

the last part restart your container app you mean the "python -m openui"

kakachiex2 avatar May 15 '24 01:05 kakachiex2

the last part restart your container app you mean the "python -m openui"

Yes, if you are running in container mode, you should use docker-compose up -d --build instead.

Feel free to cherry-pick my commits if you encounter issues generating the frontend on Windows.

dbian avatar May 15 '24 02:05 dbian

I am so sorry everyone. I totally broke the main branch 😭 . It's time I add some integration tests and prevent merges to master without them passing, this is amatuer hour. Again I appologize.

I just pushed a number of changes and a fresh build of the UI to the main branch. If you pull master and run the following from the backend dir, it should work without requiring a build of your own:

pip uninstall openui
pip install .

vanpelt avatar May 15 '24 14:05 vanpelt

@vanpelt don't be sorry, it's happened to everybody. Thank you for this awesome project ;)

clementvp avatar May 15 '24 16:05 clementvp