marvin.robot icon indicating copy to clipboard operation
marvin.robot copied to clipboard
Published 4 months ago • verified publisher icon geir-eilertsen

Select different LLMs

Open geir-eilertsen opened this issue 1 year ago • 3 comments

By using Spring profiles. Or even better switch model at runtime.

geir-eilertsen avatar Dec 20 '24 04:12 geir-eilertsen

https://towardsdatascience.com/multi-agentic-rag-with-hugging-face-code-agents-005822122930

geir-eilertsen avatar Jan 01 '25 08:01 geir-eilertsen

Use DeepSeek locally https://github.com/spring-projects/spring-ai/issues/2116

geir-eilertsen avatar Jan 27 '25 07:01 geir-eilertsen

It should be possible to use different models for different purposes, for example:

  • Chat: DeepSeek
  • Embedding: nomic-embed-text with Ollama
  • Text-to-speech:
  • Speech-to-text:

geir-eilertsen avatar Jan 27 '25 08:01 geir-eilertsen