anything-llm icon indicating copy to clipboard operation
anything-llm copied to clipboard

[FEAT]: Custom Context Window Per Chat

Open lukemauldinks opened this issue 1 year ago • 0 comments

What would you like to see?

Running AnythingLLM desktop app on Ubuntu 22.04 with ollama as a backend running locally. I have multiple models - deepseek-coder, mistral, openchat - and each model has its own workspace. I would like to be able to set the workspace using the deepseek-coder model a context window 16K while leaving openchat only supports 8K context window. I only see one location in the AnythingLLM UI to set context window and it is in the LLM Preference selection screen.

lukemauldinks avatar Mar 25 '24 19:03 lukemauldinks