Basic inference example for LLama/Mistral

[vgoklani]

Hey there,

Thanks for sharing your library!

Is there a basic Llama/Mistral example implemented that we could read through?

I'd like to test the inference code on the Mistral 7B reference implementation. Thanks!

[yzh119]

Hi @vgoklani , good idea and I'm thinking about a minimal end-to-end example (~500 loc), please stay tuned :)

[vgoklani]

Thanks! Something using nanoGPT (framework independent) would be great!

[Manojbhat09]

any update on this?