julep
julep copied to clipboard
[Feature]: Add support for multi-lingual FTS indices
trafficstars
🔖 Feature description
Right now, most of the code and the FTS settings assume english as the written language. We should add support for multi-lingual text too. For instance,
- instead of spacy
en-core-web-sm, use their multilingual models - TBD
🎤 Why is this feature needed ?
No response
✌️ How do you aim to achieve this?
No response
👀 Have you searched issues and PRs to see if this feature request has been raised before?
- [x] I checked and didn't find similar issue