dify icon indicating copy to clipboard operation
dify copied to clipboard

Feat: Add support for pgvector with Japanese keyword search

Open utsumi-fj opened this issue 10 months ago • 0 comments

Self Checks

  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [x] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

When using pgvector for vector store, keyword search, which should work by Retrieval Setting Full-Text Search and Hybrid Search, in Japanese is not supported.

For now, keyword search with pgvector uses tsvector which does not support Japanese by default.

2. Additional context or comments

No response

3. Can you help us with this feature?

  • [x] I am interested in contributing to this feature.

utsumi-fj avatar Feb 17 '25 22:02 utsumi-fj