[Fix bug] Better for local embedding models
Description
This pull request adds functionality to decode chunks back to strings, enabling the use of local embedding models that only accept string inputs.
Related Issues
https://github.com/microsoft/graphrag/issues/451 https://github.com/microsoft/graphrag/issues/528
Proposed Changes
- Decodes the encoded chunks back to strings.
- Integrates the local embedding models with the decoded strings.
Checklist
- [x] I have tested these changes locally.
- [x] I have reviewed the code changes.
- [ ] I have updated the documentation (if necessary).
- [ ] I have added appropriate unit tests (if applicable).
Additional Notes
These changes ensure compatibility with local embedding models that require string inputs, enhancing the overall functionality and flexibility of the system.
This wonderfully resolves the weight summed to zero issues. Thanks for the PR. Hope the MS team could merge this soon.
This pr is perfectly resolve error in local query,thank you very much. Hope this pr can be merge soon.
This wonderfully resolves the weight summed to zero issues. Thanks for the PR. Hope the MS team could merge this soon.
Hi @lyyf2002
Thanks for your contribution! On 0.2.2 we merged a change that should have fixed this. Could you please try with the latest version (0.3.1)?