Chelsea John

User Warnings for accessing grad attribute of non-leaf Tensors thrown with TP=1 and PP>1

3

# Problem On pretaining GPT like models using this [script](https://github.com/bigscience-workshop/Megatron-DeepSpeed/blob/7b5f175b73a12d602cdadd3ee205ed666f6d4234/pretrain_gpt.py) , with **_*tensor_parallelsim(TP)=1 and pipeline_paralleism(PP)>1 for model of any size and batch size*_** I get the following user warning multiple...

Hi, I am using Dedalus to solve 2-D Rayleigh Bénard Convection using Dedalus, and I was wondering if there was already some inbuilt function to extract or plot the Kinetic...