dialoqbase icon indicating copy to clipboard operation
dialoqbase copied to clipboard

FEATURE REQUEST: Add new models automatically using a YAML file

Open mjtechguy opened this issue 1 year ago • 4 comments

Hello,

I would like to be able to load new models automatically (specifically for Ollama) using a YAML config file.

Maybe something like dialoqbase.yaml with the following:

API_TYPE=Ollama OLLAMA_URL=http://ADDRESS:11434 MODEL_ID=llama2 MODEL_NAME=llama2 STREAMING=true

Also, maybe add something to hide the default ones:

HIDE_DEFAULT=true

Would that be possible? Thanks!

mjtechguy avatar Apr 13 '24 20:04 mjtechguy

Hey, I think you can load Ollama models via the UI. Instead of that, automatically load newly added Ollama models, right?

n4ze3m avatar Apr 14 '24 03:04 n4ze3m

Hey @mjtechguy, just to confirm, do you mean "a feature to automatically load newly added Ollama models," right? Also, Dialoqbase has a Discord server: https://discord.com/invite/SPE3npH7Wu.

n4ze3m avatar Apr 16 '24 13:04 n4ze3m

Sorry, was traveling. So, where right now you have to manually add Ollama models and embedding models in the UI.

It would be great if these could be configured at deployment time so that they already exist when a user logs in. Also, it would be nice to hide the other default models from the list if this was used in a completely private way.

mjtechguy avatar Apr 21 '24 01:04 mjtechguy

Hey, there are new model settings in the application section where you can dynamically configure fetching the ollama model, hide default third-party models, etc. Please let me know if you encounter any issues.

image

n4ze3m avatar May 03 '24 10:05 n4ze3m