RD-Agent icon indicating copy to clipboard operation
RD-Agent copied to clipboard

RuntimeError: Failed to create chat completion after 10 retries

Open Alexia0806 opened this issue 1 year ago • 6 comments

I'm encountering an issue where the program fails to create a chat completion after 10 retries. The error occurs when attempting to create an embedding using APIBackend().create_embedding(). Below is the error traceback: Image

Could anyone help me understand the root cause of this issue and suggest potential fixes? I have already tried restarting the system and re-running the process,the API is also running normally, but the issue persists.

Alexia0806 avatar Dec 19 '24 09:12 Alexia0806

Hello, can you provide more error information? For example, the message above the "warning" at the top of your screenshot.

TPLin22 avatar Dec 20 '24 14:12 TPLin22

Hello,

Thank you for your comment! I appreciate your suggestion. I’ll check the message above the "warning" and share the details here shortly. Please let me know if there’s anything else specific that could help clarify the issue.

Hello, can you provide more error information? For example, the message above the "warning" at the top of your screenshot. Image Image

Alexia0806 avatar Dec 22 '24 10:12 Alexia0806

Hello,

Thank you for your comment! I appreciate your suggestion. I’ll check the message above the "warning" and share the details here shortly. Please let me know if there’s anything else specific that could help clarify the issue.

Based on your screenshot, the issue seems to be related to the configuration of the embedding model. The error occurs in the part of the program that calls the embedding model, whereas most of the other parts call the chat model. By default, it is set to text-embedding-3-small, but the error message suggests that the model is not configured correctly. You can check the documentation at https://rdagent.readthedocs.io/en/latest/installation_and_configuration.html to compare your configuration with the documentation to see if there's an issue. If the issue persists, feel free to reply here.

TPLin22 avatar Dec 22 '24 11:12 TPLin22

Thank you for your suggestion. I’ve reviewed the configuration as per the documentation, and everything seems to be in order. However, I am still encountering the same error.

Could you please assist further or suggest any other troubleshooting steps?

Alexia0806 avatar Dec 28 '24 19:12 Alexia0806

Hello, I'm still unable to determine the issue based on the information. Could you provide more details, such as more specific config, and the commands you used to run?

TPLin22 avatar Jan 07 '25 09:01 TPLin22

Hello,

Thank you for your comment! I appreciate your suggestion. I’ll check the message above the "warning" and share the details here shortly. Please let me know if there’s anything else specific that could help clarify the issue.

Hello, can you provide more error information? For example, the message above the "warning" at the top of your screenshot.

Image Image

Hi,

Thank you for your feedback. To address the issue, you might try adding the following line to your environment variables:

EMBEDDING_USE_AZURE=True

Please let us know if this resolves the problem or if you need further assistance.

Best regards

YeewahChan avatar Jan 10 '25 05:01 YeewahChan