Knowledge base search supports Filtered Search

[xiaoyesoso]

Self Checks

• [X] I have searched for existing issues search for existing issues, including closed ones.
• [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• [X] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Searches to find the vector embedding that is most similar to the specified vector embedding. However, search results may not always be correct. I would like to be able to include filters in the search request so that the knowledge search is preceded by metadata filtering, narrowing the search from the entire collection to only entities that match the specified filter.

The search request contains chunk like % red % as a filter condition, indicating that the knowledge search should search in all entities that contain the word red in the chunk field. Specifically, knowledge search does the following:

• Filter entities that match the filter criteria carried in the search request.

• Search within filtered entities.

• Return the first K entities.

2. Additional context or comments

No response

3. Can you help us with this feature?

• [ ] I am interested in contributing to this feature.

[827648313]

This feature is really good. It really meets the needs of users. You can choose the filtering conditions of metadata by yourself: file type, creation date, keywords... This can greatly enhance the accuracy of data retrieval, including filtering conditions for file names. Thanks to the official

[hieheihei]

We also find this feature to be of great necessity. We have implemented a simple version of a similar filtering function on our own(Self Hosted). However, due to merge conflicts, it stopped working in the 0.11.x version, I'm trying to fix this functionality within our Self Hosted version. Does the official have any plans to provide support for this in the future?

[haozhuoyuan]

This feature is really good. It really meets the needs of users. You can choose the filtering conditions of metadata by yourself: file type, creation date, keywords... This can greatly enhance the accuracy of data retrieval, including filtering conditions for file names. Thanks to the official

I fully support this idea. The ability to customize metadata filtering conditions, such as file type, creation date, keywords, etc., will not only significantly enhance the accuracy of data retrieval but also meet the personalized needs of different users. The inclusion of filtering conditions for file names is especially valuable, as it will greatly improve the efficiency of data management, enabling users to quickly find the information they need among large datasets. I believe that the implementation of this feature will bring substantial benefits in practical applications and greatly enhance the user experience.

[zhang-cuishan]

最近私有化部署也遇到这个问题，希望官方将该issues早日提上日程啊！ 笔芯！

[eshaojun]

This feature is absolutely essential！

[Git-create-max]

期待这个功能上线

[827648313]

+1

[zouxiaodong]

+1

[dosubot[bot]]

Hi, @xiaoyesoso. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

• Request for a filtered search feature in the knowledge base to enhance search accuracy.
• Strong support from users like @827648313, @hieheihei, and @haozhuoyuan.
• @hieheihei implemented a similar feature but faced issues with newer versions.
• High demand for this feature, but no official resolution yet.

Next Steps:

• Please confirm if this issue is still relevant to the latest version of Dify.
• If no further input is provided, the issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

[sheiy]

+1

[dosubot[bot]]

@takatost, the user @sheiy has indicated that the request for a filtered search feature in the knowledge base is still relevant. Could you please assist them with this issue?

[xiaoyesoso]

Hi, @xiaoyesoso. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.您好，我是 Dosu，我在帮助 Dify 团队管理他们的待办事项。我将此问题标记为过时。

Issue Summary:  问题摘要：

• Request for a filtered search feature in the knowledge base to enhance search accuracy.知识库搜索请求添加过滤搜索功能以增强搜索准确性。
• Strong support from users like @827648313, @hieheihei, and @haozhuoyuan.强烈支持来自用户如、和。
• @hieheihei implemented a similar feature but faced issues with newer versions.实现了类似功能，但遇到了新版本的问题。
• High demand for this feature, but no official resolution yet.该功能需求量大，但尚未有官方解决方案。

Next Steps:  下一步：

• Please confirm if this issue is still relevant to the latest version of Dify.请确认此问题是否仍然适用于 Dify 的最新版本。
• If no further input is provided, the issue will be automatically closed in 15 days.如果没有进一步输入，问题将在 15 天后自动关闭。

Thank you for your understanding and contribution!感谢您的理解与贡献！

this issue is still relevant to the latest version of Dify

[827648313]

Hi, @xiaoyesoso. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

• Request for a filtered search feature in the knowledge base to enhance search accuracy.
• Strong support from users like @827648313, @hieheihei, and @haozhuoyuan.
• @hieheihei implemented a similar feature but faced issues with newer versions.
• High demand for this feature, but no official resolution yet.

Next Steps:

• Please confirm if this issue is still relevant to the latest version of Dify.
• If no further input is provided, the issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

Yes, the latest version does not have this function. I think this function is very necessary. Can the official support it?