tiktoken icon indicating copy to clipboard operation
tiktoken copied to clipboard

Published 20 hours ago • verified publisher icon openai

Using offline: `.tiktoken` file gets deleted automatically on Linux

Open nkilm opened this issue 10 months ago • 3 comments

Description

I'm trying to setup tiktoken locally with the help of this guide - https://stackoverflow.com/questions/76106366/how-to-use-tiktoken-in-offline-mode-computer. But the problem I'm facing is that the .tiktoken file - cl100k_base.tiktoken is getting deleted automatically after code execution on Linux machine.

OS: Linux tiktoken version - 0.6.0

nkilm avatar Apr 09 '24 12:04 nkilm

I meet the same question!

Yuxiang1995 avatar May 20 '24 07:05 Yuxiang1995

cl100k_base.tiktoken was updated, download the latest version can fix it

Yuxiang1995 avatar May 20 '24 08:05 Yuxiang1995

@Yuxiang1995 Thanks! I'll checkout and let you know.

nkilm avatar May 23 '24 04:05 nkilm

Update: Latest version of .tiktoken fixes this issue.

nkilm avatar Aug 22 '24 16:08 nkilm