ChatGLM-6B icon indicating copy to clipboard operation
ChatGLM-6B copied to clipboard

Published 20 hours ago • verified publisher icon THUDM

[Help] 推荐输入输出长度为2048指的是什么？是token数量还是字符数量？

Open gyy1768219592 opened this issue 1 year ago • 2 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

Current Behavior

  1. 推荐输入输出长度为2048指的是什么？是token数量还是字符数量？
  2. 如果是token数量，那么token数量具体是如何计算的呢？

Expected Behavior

No response

Steps To Reproduce

/

Environment

/

Anything else?

No response

gyy1768219592 avatar Jun 11 '23 08:06 gyy1768219592

token数

zx12671 avatar Sep 30 '23 03:09 zx12671

Is there an existing issue for this?

  • [x] I have searched the existing issues

Current Behavior

  1. 推荐输入输出长度为2048指的是什么？是token数量还是字符数量？
  2. 如果是token数量，那么token数量具体是如何计算的呢？

Expected Behavior

No response

Steps To Reproduce

/

Environment

/

Anything else?

No response

计算可以上网搜 token计算器

ybdesire avatar Nov 17 '23 09:11 ybdesire