DevoxxGenieIDEAPlugin icon indicating copy to clipboard operation
DevoxxGenieIDEAPlugin copied to clipboard

[FEATURE] Add more parameters to customize the model's behavior.

Open juanise opened this issue 6 months ago • 1 comments

I think it would be a good idea to have the ability to modify more parameters. In our case, it would be useful to be able to adjust the following parameters:

PARAMETER top_k 18
PARAMETER min_p 0.08
PARAMETER num_ctx 10240
PARAMETER repeat_penalty 1.1

Given the number of existing parameters, one possible way to handle this could be to add a free-text field to allow the inclusion of less common parameters.

juanise avatar Jun 09 '25 08:06 juanise

DevoxxGenie uses Langchain4J which is a higher level LLM abstraction layer API.

Will need to investigate if top_k and repeat_penalty are supported for the different LLM models...

Current status:

Image

stephanj avatar Jun 20 '25 06:06 stephanj