Claes Fransson

icon company Campus Mölndal (Student) icon location Gothenburg, Sweden icon location 👨‍💻 C# Student @ Campus Mölndal 🌱 Learning: C#, .NET, ASP.NET 🎯 Goal: Full-stack developer 📫 Contact: [email protected]

Results 52 comments of Claes Fransson

The chat keep looping and doesn't make sense

Hi, I solved this by increasing the `max_input_length` in config.toml like this (for `model.chat.local`): ``` [completion] # Maximum length of the input prompt, in UTF-8 characters. The default value is...

The chat keep looping and doesn't make sense

Actually, I still get a lot of repeating thinking, unfortunately. I've tried to experiment with different values of `max_input_length` and `max_decoding_tokens` under` [model.chat.local]`, but haven't found any setting which works...