dify icon indicating copy to clipboard operation
dify copied to clipboard

The knowledge base needs to be able to add custom fields and use them for filtering in workflow knowledge retrieval, which would be a particularly useful feature

Open miludedeng opened this issue 1 year ago • 7 comments

Self Checks

  • [X] I have searched for existing issues search for existing issues, including closed ones.
  • [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [X] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

When I call a workflow, I need to filter specific data in the knowledge base in different scenarios. However, currently dify can only retrieve information from the entire knowledge base. I have to create multiple knowledge bases and workflows. But this will be a huge workload.

2. Additional context or comments

No response

3. Can you help us with this feature?

  • [X] I am interested in contributing to this feature.

miludedeng avatar Oct 22 '24 07:10 miludedeng

Thank you for your valuable request. Adding Metadata to the knowledge base data may solve your problem. We are investigating internally. This part of the functionality is on the knowledge base product planning roadmap.

Yawen-1010 avatar Oct 22 '24 07:10 Yawen-1010

我也需要这个功能,非常需要。请问大概什么时候能上线该功能,根据不同的用户,我应当检索不同的数据集(或者说我可以根据我附带的变量选择某个数据集筛选出满足某些字段的数据)

liuzixiao666 avatar Nov 09 '24 11:11 liuzixiao666

yes, i need this fea too, is there anyway i can see your planning roadmap for this feature?

143230 avatar Nov 22 '24 11:11 143230

Any update this task ?

nhha1602 avatar Nov 29 '24 09:11 nhha1602

Hi, @miludedeng. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • You requested the ability to add custom fields to the knowledge base for better data filtering.
  • @Yawen-1010 acknowledged the request and mentioned that adding metadata might be a solution.
  • The feature is on the product planning roadmap.
  • Other users, including @liuzixiao666 and @143230, expressed a strong need for this feature.
  • @nhha1602 asked for updates on the task.

Next Steps:

  • Please let me know if this issue is still relevant to the latest version of the Dify repository by commenting here.
  • If there is no further activity, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

dosubot[bot] avatar Dec 30 '24 16:12 dosubot[bot]

This is still relevant.

christophersandmann avatar Jan 14 '25 08:01 christophersandmann

@takatost, the user @christophersandmann has indicated that this issue regarding adding custom fields to the knowledge base is still relevant. Could you please assist them with this?

dosubot[bot] avatar Jan 14 '25 08:01 dosubot[bot]

I'm facing the same issue. My workaround is converting the filter object into a string, then merging it into the user query. When the Knowledge Base retrieves it, the backend will split and parse the filter object

khanhnd0408 avatar Mar 12 '25 08:03 khanhnd0408

I'm facing the same issue. My workaround is converting the filter object into a string, then merging it into the user query. When the Knowledge Base retrieves it, the backend will split and parse the filter object

https can

liuzixiao666 avatar Mar 12 '25 08:03 liuzixiao666

See https://docs.dify.ai/guides/knowledge-base/metadata.

crazywoola avatar Mar 24 '25 08:03 crazywoola