[SUPPORT] Is the tiktoken calculation method of the 0613 model the same as the 0301 model?

[quzard]

trafficstars

https://github.com/openai/openai-cookbook/blob/main/examples/How_to_count_tokens_with_tiktoken.ipynb

[averykhoo]

based on usage.prompt_tokens and adjusting the constants, it seems to exactly match the calculation method for gpt-4-0314. i'd still like an official confirmation if possible though

[averykhoo]

update: opened PR #511

[github-actions[bot]]

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this will be closed in 10 days.