RD-Agent icon indicating copy to clipboard operation
RD-Agent copied to clipboard

Repeatedly stuck on 1st hypothesis and cannot progress

Open Liamlee97 opened this issue 6 months ago • 1 comments

❓ Questions and Help

I have been trying to execute rdagent fin_factor. But it seems the agent cannot progress beyond 1st hypothesis.

" Role:user Content: It is not the first round, the user has made several hypothesis on this scenario and did several evaluation on them. The former hypothesis and the corresponding feedbacks are as follows (focus on the last one & the new hypothesis that it provides and reasoning to see if you agree): No previous hypothesis and feedback available since it's the first round. "

I keep getting warning about extra data. Would faulty JSON parsing cause this issue?

" 2025-05-29 19:52:13.704 | INFO | rdagent.oai.backend.litellm:_create_chat_completion_inner_function:125 - Current Cost: $0.0015320400; Accumulated Cost: $0.0104591800; finish_reason='stop' 2025-05-29 19:52:33.710 | WARNING | rdagent.oai.backend.base:_try_create_chat_completion_or_embedding:342 - Extra data: line 10 column 1 (char 1130) 2025-05-29 19:52:33.715 | WARNING | rdagent.oai.backend.base:_try_create_chat_completion_or_embedding:343 - Retrying 7th time... 2025-05-29 19:52:33.722 | INFO | rdagent.oai.backend.litellm:_create_chat_completion_inner_function:83 - "

Many thanks.

Liamlee97 avatar May 30 '25 18:05 Liamlee97

Some LLM models are more prone to generating responses that do not fully adhere to the prompt requirements, leading to errors. We are attempting to make improvements in the following PR.

TPLin22 avatar Jun 05 '25 09:06 TPLin22