quarkus-langchain4j icon indicating copy to clipboard operation
quarkus-langchain4j copied to clipboard

Enable to change the LLM parameters at runtime

Open andreadimaio opened this issue 1 year ago • 8 comments

The idea is to understand if there is a way to change the parameters passed to the LLM at runtime. Today the prompt can be changed using @UserMessage and @V:

public String poem(@UserMessage String prompt, @V("topic") String topic)

but the parameters are fixed to what we have in application.properties.

andreadimaio avatar Jul 18 '24 09:07 andreadimaio