lit-llama icon indicating copy to clipboard operation
lit-llama copied to clipboard

Published 20 hours ago • verified publisher icon Lightning-AI

Where is tokenizer.model? tokenizer path

Open andreamigliorati opened this issue 10 months ago • 1 comments

Hi, I'm confused about where to find the tokenizer:

--tokenizer_path checkpoints/lit-llama/tokenizer.model

Referring here to the readme:

image

Where can I download it?

andreamigliorati avatar Apr 24 '24 15:04 andreamigliorati

Did you solve the problem?

daxian-lh avatar Jun 04 '24 06:06 daxian-lh