Choose Model for Autoprompt feature (RULE_CONFIG_GENERATE_TEMPLATE)

[AndyMik90]

Self Checks

• [X] I have searched for existing issues search for existing issues, including closed ones.
• [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [X] Pleas do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing?

Since some of the models (especially local models) have a hard time to output correct json format for the autoprompt feature (RULE_CONFIG_GENERATE_TEMPLATE prompt), I suggest being able to set the model for this feature by itself in system settings. As now it uses the system LLM, and for some users, that is not the best for creating prompts in correct format.

2. Describe the feature you'd like to see

Set the model for the prompts in the llm_generate, especially the RULE_CONFIG_GENERATE_TEMPLATE one.

3. How will this feature improve your workflow or experience?

It would allow us not to have 400 errors from some models when they are set as the system-wide LLM, and users would always get orchestrated the prompt when using the automatic feature.

4. Additional context or comments

No response

5. Can you help us with this feature?

• [ ] I am interested in contributing to this feature.

[dosubot[bot]]

Hi, @AndyMik90,

I'm helping the Dify team manage their backlog and am marking this issue as stale. The issue you raised requests the ability to set the model for the autoprompt feature separately in the system settings to address the struggle of certain models to output the correct JSON format, leading to 400 errors. As of now, the issue remains unresolved.

Could you please confirm if this issue is still relevant to the latest version of the Dify repository? If it is, please let the Dify team know by commenting on the issue. Otherwise, feel free to close the issue yourself, or it will be automatically closed in 7 days.

Thank you for your understanding and contribution to the Dify project!