Offer a more flexible log management method

[berg-wang]

Self Checks

• [x] I have searched for existing issues search for existing issues, including closed ones.
• [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• [x] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

How to manage the Logs function more flexibly, allowing only specified members or only administrators to view the chat interaction records between users and AI applications, in order to protect user privacy.

2. Additional context or comments

No response

3. Can you help us with this feature?

• [ ] I am interested in contributing to this feature.

[dosubot[bot]]

Hi, @berg-wang. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

• Proposal for a more flexible log management system to enhance user privacy.
• Aim to restrict access to chat interaction records to specified members or administrators.
• You indicated no interest in contributing to the development of this feature.
• No further comments or activity have been made on the issue.

Next Steps:

• Please let me know if this issue is still relevant to the latest version of the Dify repository by commenting here.
• If no updates are provided, the issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

[gilliankerr]

Yes this is still relevant and important.

[dosubot[bot]]

@crazywoola, the user has confirmed that this issue regarding a more flexible log management system is still relevant and important. Could you please assist them with this?

[gilliankerr]

Hello @crazywoola we might be able to contribute development or some funding for this feature.

[crazywoola]

@gilliankerr Thanks, feel free to contribute, I am a little confused how flexible do you guys want to achieve, are there any examples or scenarios?

[gilliankerr]

Hi, thanks for your response.

Scenario

My nonprofit organization is using Dify to create AI tools for Canadian nonprofits. Privacy is a big concern because nonprofits will be using Dify to analyze interview data, ask questions about how to treat people, etc. We tell them to strip Personal Identifiable Information from data but that's doesn't always happen.

Features

Privacy features should include: - Restricting access to chat logs except by administrators - Allowing users to delete chats which get deleted from the database rather than just hidden from their view - Automatic deletion of uploaded files after a designated period (e.g., 3 days) selected by the administrator - Automatic deletion of chats after a designated period (e.g., 30 days) selected by the administrator

How to contribute

Several Dify users have requested the ability to delete old chats or files (see https://github.com/langgenius/dify/discussions/11219) . A developer in the community is trying to submit a patch for this but hasn't received a response ( https://github.com/langgenius/dify/issues/12433#issuecomment-2772004682).

How can we facilitate this or contribute towards the costs of adding these features?

[crazywoola]

@gilliankerr

Please check this out. You can see the description in the PR (thanks to @kurokobo ), we have added several house-cleaning tasks to maintain the system. However, you still need to run it manually, I believe this can be resolved by adding some cron jobs to do it automatically.

feat: add administrative commands to free up storage space by removing unused files (#18835)

[gilliankerr]

This looks great thanks