LLocalSearch icon indicating copy to clipboard operation
LLocalSearch copied to clipboard

limit db result size to not "overflow" context

Open nilsherzig opened this issue 10 months ago • 0 comments

Is your feature request related to a problem? Please describe. Sometimes we get more result text back than there is model context, especially if the context is set to a low number. This results in the llm not adhering to the requested answer structure. Which results in parsing errors.

Describe the solution you'd like Limit the amount of context we use with db / websearch results.

nilsherzig avatar Apr 16 '24 13:04 nilsherzig