matrix-chatgpt-bot
matrix-chatgpt-bot copied to clipboard
Why does this send responses seperated by <|im_sep> and not im_start and im_stop?
I'm using an openai compatible api that expects im_start/im_stop, but this is sending im_sep which breaks things.
I don't see any documentation on openai for im_sep, is there a reason this is used here?