elasticsearch-jieba-plugin icon indicating copy to clipboard operation
elasticsearch-jieba-plugin copied to clipboard

ES分词插件需求征集

Open sing1ee opened this issue 6 years ago • 24 comments

之前比较忙,最近有空梳理一下分词插件的问题。 大家有什么需求都可以提出来,我这边根据需求的重要程度进行开发。

sing1ee avatar Aug 02 '19 02:08 sing1ee

你好 ,请问怎么在不停止服务更新词典,我试了下替换词典,reopen index 词典貌似不生效

wa-ooo avatar Aug 11 '19 10:08 wa-ooo

es集成jieba分词做全文检索的时候,es的高亮显示会发生偏移。原因是jieba记载postion的方式和es不融洽。我做了修改,问题已经解决,发现效果很好。 https://github.com/wangyifaer/esplugins-jieba

wangyifaer avatar Sep 19 '19 08:09 wangyifaer

您好还有一个问题,es结成jieba后,一旦加入自定义分词,就会导致所有es索引自动关闭,原因应该是读取自定义词典失败

wangyifaer avatar Sep 19 '19 08:09 wangyifaer

提一个PR吧

wangyifaer [email protected] 于2019年9月19日周四 下午4:23写道:

es集成jieba分词做全文检索的时候,es的高亮显示会发生偏移。原因是jieba记载postion的方式和es不融洽。我做了修改,问题已经解决,发现效果很好。 https://github.com/wangyifaer/esplugins-jieba http://url

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/sing1ee/elasticsearch-jieba-plugin/issues/40?email_source=notifications&email_token=AAICIWQRM3KL7X4IPXQVWELQKMZJNA5CNFSM4IIZ2UE2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD7CU26A#issuecomment-533024120, or mute the thread https://github.com/notifications/unsubscribe-auth/AAICIWW7KVSOGMDVKQ5XXUTQKMZJNANCNFSM4IIZ2UEQ .

sing1ee avatar Sep 20 '19 02:09 sing1ee

jieba字典怎么热更新?

nuass avatar Mar 05 '20 09:03 nuass

jieba字典怎么热更新?

同问

leafney avatar Mar 30 '20 10:03 leafney

能否加入对自定义词典的热更新功能, 每次重启服务太伤了

yataosu avatar Apr 22 '20 02:04 yataosu

更新词典,之前已经创建的索引该如何处理呢?

[email protected] 于2020年4月22日周三 上午10:57写道:

能否加入对自定义词典的热更新功能, 每次重启服务太伤了

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/sing1ee/elasticsearch-jieba-plugin/issues/40#issuecomment-617518884, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAICIWSAI34APHOBMD5G5NTRNZMJLANCNFSM4IIZ2UEQ .

sing1ee avatar Apr 22 '20 13:04 sing1ee

@nuass @leafney @Old-Su 字典的热更新可以加,不过有一个疑问:更新字典,总是需要重建索引的。

sing1ee avatar Apr 22 '20 13:04 sing1ee

什么时候能跟上es 的官方版本呀,7.70 了

iwaitu avatar May 14 '20 12:05 iwaitu

@iwaitu OK了

sing1ee avatar May 28 '20 13:05 sing1ee

@wa-ooo @nuass @leafney 最新的master分支和7.7.0的分支都支持字典的热更新了。具体使用见在线更新字段说明

sing1ee avatar Jun 06 '20 14:06 sing1ee

还有7.6.2的版本么?

jerry-00 avatar Feb 01 '21 06:02 jerry-00

还有7.6.2的版本么?

这个改一下版本号,自己打包即可。

sing1ee avatar Feb 10 '21 11:02 sing1ee

为啥我用7.7.0版本改6.8.0版本也没有热更新

icelighting avatar Apr 07 '21 02:04 icelighting

我使用的es是7.9.2,下载源码后,修改build.gradle,plugin-descriptor.properties文件对应的版本后执行gradle pz,报如下错误

  • What went wrong: Could not determine the dependencies of task ':pz'.

Could not resolve all task dependencies for configuration ':distJars'. Could not resolve project :jieba-analysis. Required by: project : > Project : declares a dependency from configuration 'compile' to configuration 'default' which is not declared in the descriptor for project :jieba-analysis.

  • Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

  • Get more help at https://help.gradle.org

phpsxg avatar Apr 07 '21 12:04 phpsxg

还有7.6.2的版本么?

这个改一下版本号,自己打包即可。

你那边打包正常吗,我这边打包报错如下: Downloading https://services.gradle.org/distributions/gradle-4.4.1-bin.zip

Exception in thread "main" java.net.ConnectException: Connection timed out (Connection timed out)

phpsxg avatar Apr 08 '21 00:04 phpsxg

网络得问题,想想办法

孙晓光 @.***> 于2021年4月8日周四 上午8:47写道:

还有7.6.2的版本么?

这个改一下版本号,自己打包即可。

你那边打包正常吗,我这边打包报错如下: Downloading https://services.gradle.org/distributions/gradle-4.4.1-bin.zip

Exception in thread "main" java.net.ConnectException: Connection timed out (Connection timed out)

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/sing1ee/elasticsearch-jieba-plugin/issues/40#issuecomment-815366937, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAICIWXI3K4DHTTOCVI3TKLTHT4JVANCNFSM4IIZ2UEQ .

sing1ee avatar Apr 08 '21 03:04 sing1ee

网络得问题,想想办法 孙晓光 @.***> 于2021年4月8日周四 上午8:47写道: 还有7.6.2的版本么? 这个改一下版本号,自己打包即可。 你那边打包正常吗,我这边打包报错如下: Downloading https://services.gradle.org/distributions/gradle-4.4.1-bin.zip Exception in thread "main" java.net.ConnectException: Connection timed out (Connection timed out) — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#40 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAICIWXI3K4DHTTOCVI3TKLTHT4JVANCNFSM4IIZ2UEQ . 执行gradel pz报如下错误,你遇到过吗

root@DESKTOP-LAKGMPD:/mnt/f/STHG/install/ElasticSearch/aaa/elasticsearch-jieba-plugin-7.7.1# gradle pz

FAILURE: Build failed with an exception.

* What went wrong:
Could not determine the dependencies of task ':pz'.
> Could not resolve all task dependencies for configuration ':distJars'.
   > Could not resolve project :jieba-analysis.
     Required by:
         project :
      > Project : declares a dependency from configuration 'compile' to configuration 'default' which is not declared in the descriptor for project :jieba-analysis.

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 1s
root@DESKTOP-LAKGMPD:/mnt/f/STHG/install/ElasticSearch/aaa/elasticsearch-jieba-plugin-7.7.1#

phpsxg avatar Apr 08 '21 03:04 phpsxg

es集成jieba分词做全文检索的时候,es的高亮显示会发生偏移。原因是jieba记载postion的方式和es不融洽。我做了修改,问题已经解决,发现效果很好。 https://github.com/wangyifaer/esplugins-jieba

高亮问题具体要怎么改?能说说吗?我也碰到这个问题了

hezhiqiang avatar Oct 12 '21 09:10 hezhiqiang

能否加自定义分词功能,用户可以配置,比如:说客英语 => 说客英语 , 说客,这个说客英语就被分词为说客英语和说客

hezhiqiang avatar Oct 13 '21 03:10 hezhiqiang

高亮问题具体要怎么改?能说说吗?我也碰到这个问题了

这个问题,我来看一下。具体给我个例子吧

sing1ee avatar Oct 14 '21 15:10 sing1ee

es集成jieba分词做全文检索的时候,es的高亮显示会发生偏移。原因是jieba记载postion的方式和es不融洽。我做了修改,问题已经解决,发现效果很好。 https://github.com/wangyifaer/esplugins-jieba

高亮问题具体要怎么改?能说说吗?我也碰到这个问题了

注意一下高亮那块的代码是否有问题,或者升级es最新版本试试,有可能是分词器和es兼容导致的。如果还不行,就自己修改一下es源码里的position定位那块内容

wangyifaer avatar Oct 15 '21 02:10 wangyifaer

现在有版本可以支持动态删除词库吗,我看只有新加词库

zyokia avatar Feb 04 '24 09:02 zyokia