Jiang Jiwen

icon indicating a website link https://jiwenj.github.io/

icon company Institute of Automation, Chinese Academy of Sciences icon location Nanjing

Results 1 comments of Jiang Jiwen

Huggingface <-> Megatron-LM Compatibility

> ## 1. Convert llama-2 from HuggingFace to Megatron-LM: > ``` > PYTHONPATH=$(pwd) tools/checkpoint/util.py --model-type=GPT --loader=llama2_hf --load-dir= --save-dir= --tokenizer-model= > ``` > > ## 2. Convert llama-2 from Megatron-LM to...