dify icon indicating copy to clipboard operation
dify copied to clipboard

Agent Mode of MiniMax Abab series have only ReAct

Open ifsheldon opened this issue 1 year ago • 1 comments

Self Checks

Dify version

0.5.2

Cloud or Self Hosted

Cloud, Self Hosted (Docker)

Steps to reproduce

  1. Open the editor of an agent
  2. Select a LLM from MiniMax, say Abab-6-Chat
  3. Change the type of the agent as Agent Asssitant and click the below Agent Settings button
  4. On the pop up sidebar, there's only one mode for this agent, which is ReAct

✔️ Expected Behavior

Provide one more agent mode for MiniMax Abab series. That is simply Function Calling

❌ Actual Behavior

There's only one mode for MiniMax agent, which is ReAct.

I think MiniMax models natively support function calling, so it's a bit weird for me that there's only one option ReAct. When the requirements are basic, say looking up for weather infor, I think using ReAct strategy is just overkill.

ifsheldon avatar Jan 26 '24 10:01 ifsheldon

🤖

Hey there @ifsheldon! Good to see you back here. Hope you're having a great day!

Thank you for your detailed report, ifsheldon. I understand your concern about the lack of Function Calling mode for the MiniMax Abab series in dify.

Based on the information available in the dify repository, it's clear that the current version of dify (v0.5.2) does support the Function Calling mode for LLMs. This is evident from the test_invoke_chat_model_with_tools function in the test_llm.py file. However, it seems that this mode is not currently supported for the MiniMax Abab series of LLMs. The mode for the abab5.5s-chat model is set to chat, not Function Calling, as shown in the abab5.5s-chat.yaml file.

As for the difference between the ReAct mode and the Function Calling mode, in the context of dify's LLMs, the ReAct mode is used when the model is expected to generate a response based on the given prompt, while the Function Calling mode is used when the model is expected to perform a specific function or action based on the given prompt. This is demonstrated in the llm.py file.

I agree with you that having the Function Calling mode for the MiniMax Abab series could be beneficial for simpler tasks. However, as of now, it seems that this feature is not yet implemented. I recommend keeping an eye on the dify repository for any updates regarding this feature. If you have any further questions or concerns, feel free to ask.

-Dosu

Sources


This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.

dosubot[bot] avatar Jan 26 '24 10:01 dosubot[bot]

Already supported #2247

Yeuoly avatar Jan 30 '24 11:01 Yeuoly