mlx-swift-examples icon indicating copy to clipboard operation
mlx-swift-examples copied to clipboard

When I upgraded my Swift Package Manager dependencies, the <think> </think> tags didn't match

Open LLLLLayer opened this issue 8 months ago • 1 comments

deepSeek <think> and </think> do not match. Image Image

LLLLLayer avatar Mar 17 '25 18:03 LLLLLayer

Actually I think the chat template for some thinking models was updated so that the prompt starts with a <think> tag to force a thinking block. You'll need to accommodate this in your app.

DePasqualeOrg avatar Mar 17 '25 19:03 DePasqualeOrg