DevoxxGenieIDEAPlugin
DevoxxGenieIDEAPlugin copied to clipboard
[FEATURE] Add more parameters to customize the model's behavior.
I think it would be a good idea to have the ability to modify more parameters. In our case, it would be useful to be able to adjust the following parameters:
PARAMETER top_k 18
PARAMETER min_p 0.08
PARAMETER num_ctx 10240
PARAMETER repeat_penalty 1.1
Given the number of existing parameters, one possible way to handle this could be to add a free-text field to allow the inclusion of less common parameters.
DevoxxGenie uses Langchain4J which is a higher level LLM abstraction layer API.
Will need to investigate if top_k and repeat_penalty are supported for the different LLM models...
Current status: