hi, could you provide a code like llama3?

[lambda7xx]

trafficstars

hi, Dear DeepSeek team:

if your team could provide a implementation like https://github.com/meta-llama/llama3/tree/main/llama, it will be great. Llama3 is very helpful to learn.

[SupercarryNg]

Maybe you are looking for https://huggingface.co/deepseek-ai/DeepSeek-V2-Lite/blob/main/modeling_deepseek.py

[lambda7xx]

Maybe you are looking for https://huggingface.co/deepseek-ai/DeepSeek-V2-Lite/blob/main/modeling_deepseek.py

I think if the deepseek team can maintain a repo like llama, it will be great. In llama repo, it has a model implementation and a example to run the model(https://github.com/meta-llama/llama3/blob/main/example_text_completion.py).