NeMo icon indicating copy to clipboard operation
NeMo copied to clipboard

Convert Llama-7b to nemo: checkpoint ckpts are not saved as a model_weights.ckpt file

Open yanzhaodong2024 opened this issue 10 months ago • 2 comments

While I am trying to convert llama-hf model to Nemo via scripts/nlp_language_modeling/convert_llama_hf_to_nemo.py, the checkpoints are saved with each params type as a separate folder, as below image However, when I am running Nemo-aligner, I was told that a model_weights.ckpt file is required, what is the problem here?

btw: I am using the latest version of Nemo

yanzhaodong2024 avatar Mar 27 '24 08:03 yanzhaodong2024

The converter convert_llama_hf_to_nemo.py should produce a .nemo file, not a dir. Can you try using NeMo docker image? https://catalog.ngc.nvidia.com/orgs/nvidia/containers/nemo

qijiaxing avatar Apr 02 '24 02:04 qijiaxing

This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.

github-actions[bot] avatar May 03 '24 01:05 github-actions[bot]

This issue was closed because it has been inactive for 7 days since being marked as stale.

github-actions[bot] avatar May 10 '24 01:05 github-actions[bot]