TransformerOptimus
Future request
⚠️ Check for existing issues before proceeding. ⚠️
- [X] I have searched the existing issues, and there is no existing issue for my problem
Where are you using SuperAGI?
Windows
Which branch of SuperAGI are you using?
Main
Do you use OpenAI GPT-3.5 or GPT-4?
GPT-3.5
Which area covers your issue best?
Installation and setup
Describe your issue.
How can i put a model into training mode please
How to replicate your Issue?
No response
Upload Error Log Content
docker compose logs
ok i would like to try some of the other open source models aprt from openai, i have tried to change the model name in the setup file but i guess i need to do more that that as it just stopped working
For locally hosted LLMs comment out the next line and uncomment the one after
to configure a local llm point your browser to 127.0.0.1:7860 and click on the model tab in text generation web ui.
OPENAI_API_BASE: https://api.openai.com/v1 #OPENAI_API_BASE: http://super__tgwui:5001/v1
"gpt-3.5-turbo-0301": 4032, "gpt-4-0314": 8092, "gpt-3.5-turbo": 4032, "gpt-4": 8092, "gpt-4-32k": 32768, "gpt-4-32k-0314": 32768, "llama":2048, "mpt-7b-storywriter":45000
MODEL_NAME: gpt-3.5-turbo RESOURCES_SUMMARY_MODEL_NAME: 0301 MAX_TOOL_TOKEN_LIMIT: 800 MAX_MODEL_TOKEN_LIMIT: 2048
this is set to use openai a would like to try another model like llama":2048, "mpt-7b-storywriter":45000 i changed the setting to OPENAI_API_BASE: http://super__tgwui:5001/v1 and hashed out OPENAI_API_BASE: https://api.openai.com/v1 but it didn't work.