How to convert lit-llama pretrained model to HF format?

[karkeranikitha]

Hi

I have pretrained a model and have it in lit-llama format. How can I convert it to huggingface format? I need to load my pretrained model via HuggingFace for inference. There are no scripts for lit-llama to HF format. Kindly suggest any approach or provide the script for the same.

Thanks in advance.

[rasbt]

I am not entirely sure, but https://github.com/Lightning-AI/lit-llama/blob/main/scripts/convert_checkpoint.py might be doing that