google
Proposal for OpenHarmony Adaptation of [ sentencepiece ]
Background
OpenHarmony is an open-source operating system and community that is widely used in the field of intelligent terminals.
Sentencepiece for unsupervised text tokenizer for neural network based text generation. In order to enable sentencepiece to support the OpenHarmony system, we have modified some of the code of sentencepiece. We plan to submit the modified code to the sentencepiece community. The purpose of creating this Issue is to initiate discussions with the community. We sincerely welcome you to put forward your valuable suggestions.
Adaptation Proposal
We have completed the adaptation of sentencepiece on OpenHarmony. The specific content is as follows:
- The construction/packaging of sentencepiece was realized based on the OpenHarmony environment and development tools.
- Provide sample examples of using sentencepiece in OpenHarmony application development.
We'll submit the adaptation code through a Pull Request (PR) promptly.
Testing Results
Based on the OpenHarmony system, we conducted unit tests on sentencepiece using the original library test cases and passed the tests in the following versions:
DevEco Studio 5.0.3 Release-5.0.9.221, SDK: API15(OpenHarmony 5.0.3.135)
DevEco Studio 5.0.4 Beta1-5.0.9.320, SDK: API16 (OpenHarmony 5.0.4.150)
DevEco Studio 5.0.3 Release-5.0.9.300, SDK: API15(OH_SDK 5.0.3.135(SP1))
DevEco Studio 5.0.4 Beta1 5.0.9.320, SDK: API16(OH SDK 5.0.4.150)
If necessary, we can provide detailed test reports at any time.
Labels
enhancement, compatibility, cross-platform
