TinyLlama
                                
                                 TinyLlama copied to clipboard
                                
                                    TinyLlama copied to clipboard
                            
                            
                            
                        Llama 3
Given that we have only Llama 3 70B and 8B, it would be useful to have a Tiny Llama based on the Llama 3 tokenizer so that we can use it as a drafting model for speculative decoding.
Are there plans to create a Llama 3 version?