void icon indicating copy to clipboard operation
void copied to clipboard

[App] reasoning content doesn't display

Open Sherlock-Holo opened this issue 7 months ago • 11 comments

版本: 1.99.30005
提交: 1.3.0
日期: fcd445d875fa8fc543c201158990832b4d7f2647
Electron: 2025-05-06T00:26:52.558Z
ElectronBuildId: 34.5.4
Chromium: undefined
Node.js: 132.0.6834.210
V8: 20.19.0
OS: 13.2.152.41-electron.0
  1. Describe the issue/feature here.

when using the deepseek-r1 or qwen3-235b-a2b(with thinking mode)

void doesn't display the reasoning content, and I doesn't found any config to let void display the reasoning content

I believe the reasoning content is important to someone want to know how the model think about the job, such as me~

Sherlock-Holo avatar May 06 '25 11:05 Sherlock-Holo

Need to know the provider! DeepSeek R1 shows reasoning in the cases we know about.

andrewpareles avatar May 06 '25 13:05 andrewpareles

Need to know the provider! DeepSeek R1 shows reasoning in the cases we know about.

I use openai compatible provider

the same provider use in previous version void will display reasoning content

Sherlock-Holo avatar May 06 '25 13:05 Sherlock-Holo

How are you hosting DeepSeek?

andrewpareles avatar May 06 '25 14:05 andrewpareles

How are you hosting DeepSeek?

we have a deepseek r1 671b running on vllm

Sherlock-Holo avatar May 06 '25 14:05 Sherlock-Holo

in deepseek-r1or qwen3-235b-a2b, the reasoning content is in the reasoning_content field not in the <think></think> tags, I confirmed by check the http response in wireshark

Sherlock-Holo avatar May 07 '25 02:05 Sherlock-Holo

@andrewpareles hello, is there any updated of this?

Sherlock-Holo avatar May 09 '25 06:05 Sherlock-Holo

@andrewpareles is it easy for you to add this or should I look into it?

mathewpareles avatar May 09 '25 06:05 mathewpareles

Sorry for missing this! Can you look into this? We just need to copy the reasoning_content field that we're using in deepseekSettings to vLLM. Thanks!

andrewpareles avatar May 10 '25 00:05 andrewpareles

@mathewpareles @andrewpareles hello, is there any progress on this?

Sherlock-Holo avatar May 19 '25 11:05 Sherlock-Holo

@mathewpareles @andrewpareles hello, after 2 weeks, is there any progress on this?

Sherlock-Holo avatar Jun 03 '25 02:06 Sherlock-Holo

I notice the deepseek provider config is

const deepseekSettings: VoidStaticProviderInfo = {
	modelOptions: deepseekModelOptions,
	providerReasoningIOSettings: {
		// reasoning: OAICompat +  response.choices[0].delta.reasoning_content // https://api-docs.deepseek.com/guides/reasoning_model
		output: { nameOfFieldInDelta: 'reasoning_content' },
	},
	modelOptionsFallback: (modelName) => { return null }
}

can void allow custom model to set the

providerReasoningIOSettings: {
		// reasoning: OAICompat +  response.choices[0].delta.reasoning_content // https://api-docs.deepseek.com/guides/reasoning_model
		output: { nameOfFieldInDelta: 'reasoning_content' },
	},

to parse reasoning content?

Sherlock-Holo avatar Jun 03 '25 07:06 Sherlock-Holo