talemate
talemate copied to clipboard
Suggestion: allow post-history instruction for local models
I've been trying out Talemate as a regular user of SillyTavern and I'm trying to work out how to get Talemate to produce the quality of output ST can produce when working with locally hosted models. I think the equivalent of the main prompt is 'Instructions' under the Conversation agent, but there doesn't seem to be an option for post-history; certain local models (mistral nemo and llama 3 derived things, recently) benefit from a post-history prompt (inserted directly after all messages in chat).
I tried to match generation settings for the Conversation agent to the settings I have in ST as best I could, providing both Talemate and ST with the same initial message and reply from me. I had the default character set up identically, and recorded the output I got from both ST and Talemate:
Output from ST:
Output from Talemate:
I'm aware this very much wasn't a fair test as the prompt and post-history I use in ST were written for how ST handles things, and not how Talemate handles things, but there's a distinct difference in quality between the output in ST and the output in Talemate, and Talemate's output looks very much like what I'll get in ST if I disable the post-history addition. Have I missed somewhere post-history can be specified (in ST I have to force it with a lorebook insertion at depth 0, for local models), or is it just not supported for agents (for local models, or generally)?
Overall I'm impressed with the features Talemate has, but right now I'm just not getting better results than I do from ST.