PaddleNLP icon indicating copy to clipboard operation
PaddleNLP copied to clipboard

如何安装FasterTokenizer

Open ZTurboX opened this issue 3 years ago • 8 comments

如何安装FasterTokenizer,说明文档是空的

ZTurboX avatar Jun 30 '22 00:06 ZTurboX

pip install faster_tokenizer

tianxin1860 avatar Jun 30 '22 00:06 tianxin1860

pip install faster_tokenizer

Looking in indexes: https://mirror.baidu.com/pypi/simple ERROR: Could not find a version that satisfies the requirement faster_tokenizer (from versions: none) ERROR: No matching distribution found for faster_tokenizer

ZTurboX avatar Jun 30 '22 01:06 ZTurboX

你的系统是不是windows系统?windows的faster_tokenizer会在后续的版本发布

wawltor avatar Jun 30 '22 02:06 wawltor

你的系统是不是windows系统?windows的faster_tokenizer会在版本发布

是win系统。“windows的faster_tokenizer会在版本发布“这个什么意思

ZTurboX avatar Jun 30 '22 02:06 ZTurboX

抱歉,是在后续的版本发布

wawltor avatar Jun 30 '22 02:06 wawltor

抱歉,是在后续的版本发布

好的

ZTurboX avatar Jun 30 '22 02:06 ZTurboX

@joey12300 看看是否完善下faster_tokenizer的文档

ZeyuChen avatar Jun 30 '22 16:06 ZeyuChen

pip install faster_tokenizer

Looking in indexes: https://mirror.baidu.com/pypi/simple ERROR: Could not find a version that satisfies the requirement faster_tokenizer (from versions: none) ERROR: No matching distribution found for faster_tokenizer

在Mac下安装也出现同样的报错

lhr0909 avatar Aug 30 '22 04:08 lhr0909

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动,被标记为stale。

github-actions[bot] avatar Dec 22 '22 00:12 github-actions[bot]

This issue was closed because it has been inactive for 14 days since being marked as stale. 当前issue 被标记为stale已有14天,即将关闭。

github-actions[bot] avatar Jan 06 '23 00:01 github-actions[bot]