Ze Ch

I found a script in transformers https://github.com/huggingface/transformers/blob/main/src/transformers/models/megatron_gpt2/convert_megatron_gpt2_checkpoint.py anyone tried this before? It seems to convert a gpt2 from Megatron format to huggingface format

> ``` > outputs = llm.generate( > prompt_token_ids=input_tokenized_prompt, # input_tokenized_prompt is a list > use_tqdm=True, > sampling_params=sampling_params, > ) > ``` > > I think u can pack the prompts...