dify
dify copied to clipboard
Agent Mode of MiniMax Abab series have only ReAct
Self Checks
- [X] I have searched for existing issues search for existing issues, including closed ones.
- [X] I confirm that I am using English to file this report (我已阅读并同意 Language Policy).
Dify version
0.5.2
Cloud or Self Hosted
Cloud, Self Hosted (Docker)
Steps to reproduce
- Open the editor of an agent
- Select a LLM from MiniMax, say Abab-6-Chat
- Change the type of the agent as Agent Asssitant and click the below Agent Settings button
- On the pop up sidebar, there's only one mode for this agent, which is
ReAct
✔️ Expected Behavior
Provide one more agent mode for MiniMax Abab series. That is simply Function Calling
❌ Actual Behavior
There's only one mode for MiniMax agent, which is ReAct.
I think MiniMax models natively support function calling, so it's a bit weird for me that there's only one option ReAct. When the requirements are basic, say looking up for weather infor, I think using ReAct strategy is just overkill.
🤖
Hey there @ifsheldon! Good to see you back here. Hope you're having a great day!
Thank you for your detailed report, ifsheldon. I understand your concern about the lack of Function Calling mode for the MiniMax Abab series in dify.
Based on the information available in the dify repository, it's clear that the current version of dify (v0.5.2) does support the Function Calling mode for LLMs. This is evident from the test_invoke_chat_model_with_tools function in the test_llm.py file. However, it seems that this mode is not currently supported for the MiniMax Abab series of LLMs. The mode for the abab5.5s-chat model is set to chat, not Function Calling, as shown in the abab5.5s-chat.yaml file.
As for the difference between the ReAct mode and the Function Calling mode, in the context of dify's LLMs, the ReAct mode is used when the model is expected to generate a response based on the given prompt, while the Function Calling mode is used when the model is expected to perform a specific function or action based on the given prompt. This is demonstrated in the llm.py file.
I agree with you that having the Function Calling mode for the MiniMax Abab series could be beneficial for simpler tasks. However, as of now, it seems that this feature is not yet implemented. I recommend keeping an eye on the dify repository for any updates regarding this feature. If you have any further questions or concerns, feel free to ask.
-Dosu
Sources
- api/tests/integration_tests/model_runtime/openai/test_llm.py
- api/core/model_runtime/model_providers/minimax/llm/abab5.5s-chat.yaml
- api/core/model_runtime/model_providers/openai/llm/llm.py
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.
Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.
If you want to continue the conversation, start your reply with @dosu-bot.
Already supported #2247