TinyLlama icon indicating copy to clipboard operation
TinyLlama copied to clipboard

Llama 3

Open cduk opened this issue 1 year ago • 2 comments

Given that we have only Llama 3 70B and 8B, it would be useful to have a Tiny Llama based on the Llama 3 tokenizer so that we can use it as a drafting model for speculative decoding.

Are there plans to create a Llama 3 version?

cduk avatar May 22 '24 22:05 cduk