jan icon indicating copy to clipboard operation
jan copied to clipboard

idea: Render CoT/reasoning for remote/custom providers

Open david-menloai opened this issue 6 months ago • 1 comments

Problem Statement

with remote models which support CoT, Jan receives the data, just don't render it Can we support this feature?

Feature Idea

with remote models which support CoT, Jan receives the data, just don't render it Can we support this feature?

david-menloai avatar Jun 06 '25 03:06 david-menloai

For nonstreaming data, The reasoning is in choices[0].message.reasoning_content in deepseek format.

For streaming data, it's in choices[0].delta.reasoning_content.

This structure depends on model's chat template. Not all reasoning models do this but this is getting the norm.

qnixsynapse avatar Jun 06 '25 05:06 qnixsynapse

Will be addressed by #5775

LazyYuuki avatar Aug 04 '25 16:08 LazyYuuki