misska1

Stage2.1训练时报错

1

检查代码时发现未实现_get_feed_dict()

Question about downloading checkpoints of 6.3B，2.5B，1.3B

3

Does BigScience also provide the original BLOOM checkpoints (without conversion to Huggingface 🤗). I am working on finetuning BLOOM (6.3B，2.5B，1.3B) and I need those checkpoint files. [issues/315](https://github.com/bigscience-workshop/Megatron-DeepSpeed/issues/315) In [https://github.com/bigscience-workshop/bigscience/tree/master/train/tr1-13B-base](url) ,I...

grad norm increase strangely

12

When I run this [https://github.com/bigscience-workshop/bigscience/blob/master/train/tr11-176B-ml/smaller_models/tr11f-6B3-ml-continuation.slurm](https://github.com/bigscience-workshop/bigscience/blob/master/train/tr11-176B-ml/smaller_models/tr11f-6B3-ml-continuation.slurm) script to continue training the model ,I got a strange grad norm and huge loss after auto reduced loss-scale of overflow .Just like I am...