Comments (4)
hemingwang0902
commented on August 26, 2024
会不会是因为你将 mydict.dic 和 sougou.dict 以 GBK 编码保存的？ IK分词器从文件中读取词典时，是使用 UTF-8 编码读取的……
from analysis-ik.
vincentwyshan
commented on August 26, 2024
我确认过了, 是 UTF8 编码的
而且从日志中看到 ik-analyzer 并没有尝试去加载这两个词典
from analysis-ik.
vincentwyshan
commented on August 26, 2024
问题已经解决了
- logs中没有打印加载 mydict.dic 和 sougou.dict 的日志信息, 但实际上是加载了这两个词典
- 我用 elasticsearch-service wraper 安装, 之前只是重新修改dict文件内容然后重启service, 确实没有生效, uninstall service wraper 之后再安装, 新加的词典生效
猜测问题出在 service wraper 启动 elasticsearch 时的调用方式
from analysis-ik.
medcl
commented on August 26, 2024
fixed ce6e7fd
from analysis-ik.
Related Issues (20)
- 英文数词被标记为 CN_WORD HOT 3
- 缺少opensearch以往版本的ik分词器 HOT 4
- https://release.infinilabs.com/analysis-ik/stable/ 里 ik只有opensearch版本，没有 HOT 2
- 如何修改 analysis-ik 支持的 Elasticsearch版本号？ HOT 4
- 希望提供8.13.2、7.17.19版本插件 HOT 2
- 希望提供 7.17.17 版本插件 HOT 1
- 为什么加入ik分词器后，kibana无法进行启动(版本都是与es对应的） HOT 4
- 希望提供 OpenSearch 2.13.0 版本插件 HOT 1
- 求7.17.20版本的ik HOT 2
- 希望提供V8.13.2版本
- 希望提供v7.17.20版本插件 HOT 1
- ik无法按照main.dic字典分词，比如创立，已经在词典了，但ik_smart的时候分不出来 HOT 1
- failed to find global analyzer [ik_smart] HOT 1
- OpenSearch 2.14.0 构建 HOT 1
- IK分词器量词问题 HOT 1
- ik for 7.17.22 HOT 3
- 是否支持ElasticSearch v8.14.0版本的中文分词？ HOT 3
- Failed installing IK
- 如何使用ik分词器搜索emoji表情？IK分词器会自动过滤Emoji和特殊符号表情。 HOT 1
- 如何对中文古籍中的生僻字进行分词？一些属于Unicode扩展区汉字会被过滤掉
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from analysis-ik.