FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Published 20 hours ago • verified publisher icon lm-sys

count_token seems return incorrect values for ChatGLM model

Open codingfun2022 opened this issue 2 years ago • 0 comments

Give prompt: [['Human', 'Hello! What is your name?'], ['Assistant', None]], the count_token api will returns 2 which is the history length instead of token count. See the following screenshots: img_v2_02f3d397-496b-4a35-a7da-95a7c14eaefg img_v2_3ff8ba7c-fcce-4016-af23-934f2c0e0b4g

codingfun2022 avatar Jun 15 '23 10:06 codingfun2022