matrix-chatgpt-bot icon indicating copy to clipboard operation
matrix-chatgpt-bot copied to clipboard

Why does this send responses seperated by <|im_sep> and not im_start and im_stop?

Open ACiDGRiM opened this issue 1 year ago • 0 comments

I'm using an openai compatible api that expects im_start/im_stop, but this is sending im_sep which breaks things.

I don't see any documentation on openai for im_sep, is there a reason this is used here?

ACiDGRiM avatar Feb 22 '24 06:02 ACiDGRiM