sambar1729 issues

Repositories
Issues
Comments

Results 2 issues of


                                            sambar1729

[QUESTION] Sample idx, bin files in public domain for trying out pretrain_gpt.py?

**Your question** Ask a clear and concise question about Megatron-LM. Can we have a sample idx + bin files as required by the pretrain_gpt.py ? Running tools/preprocess_data.py on some sample...

[QUESTION]How to convert a huggingface checkpoint, and also use PP > 1 or TP > 1

**Your question** I want to ingest a checkpoint from HF into Megatron LM and then continue training on that. For the latter part (training) I will need TP > 1...