DevoxxGenieIDEAPlugin icon indicating copy to clipboard operation
DevoxxGenieIDEAPlugin copied to clipboard

[FEATURE] Configure Embedding Model

Open rafgitdz opened this issue 10 months ago • 1 comments

Description

Currently, the embedding model used by Devoxx Genie is fixed and cannot be configured dynamically. This feature aims to provide flexible configuration options for the embedding model, allowing users to select and adjust the model based on their specific needs.

Proposed Solution

  • Add a configuration parameter to specify the embedding model to be used.
  • Support multiple configuration options:
    • Via environment variables (DEVOXX_GENIE_EMBEDDING_MODEL)
    • Via the UI (if applicable)
  • Implement dynamic model loading at application startup.
  • Add error handling to prevent failures if the specified model is unavailable.

Benefits

  • Greater flexibility for users.
  • Ability to experiment with different embedding models without modifying the code.
  • Improved adaptability to specific application needs.

rafgitdz avatar Feb 20 '25 00:02 rafgitdz

I assume you're referring to the RAG embedding using nomic-embed-text ?

com.devoxx.genie.service.chromadb.ChromaEmbeddingService.java

private void initEmbeddingModel() {
        this.embeddingModel = OllamaEmbeddingModel.builder()
                .baseUrl(stateService.getOllamaModelUrl())
                .modelName("nomic-embed-text")
                .build();
    }

stephanj avatar Feb 20 '25 10:02 stephanj