Reza Yazdani

Hi @niumanar, @asafkar and @anselmwang, I just wanted to see if you get a chance to use this PR and see if it fixed the issue? Thanks, Reza

Hi @Eichhof, Can you please confirm if you are running this in administrative mode? Thanks, Reza

Hi @n00mkrad and @d8ahazard, I wonder if you have any update on whether this PR solved the Windows installation issue? Thanks, Reza

Hi @mallorbc, We have added a test-suite [here ](https://github.com/microsoft/DeepSpeedExamples/pull/223)that measure the memory consumption after `init_inference` and also the pipeline creation. Can you please try it to see if the memory...

Closing the issue due to staleness. Please open if this is still an issue. Thanks, Reza

Hi @molly-smith, Please try updating your transformers to the latest and the issue will be resolved. Thanks, Reza

Hi Owais, Thanks again for pointing this possible bug in the deepspeed example. We are discussing this in the team and will merge it soon if there is no accuracy...

Hi @wooparadog and @Arain-sh, Can you please give me the config that you are running this with so that I can try to reproduce it on my end? Thanks, Reza

I did try the same on my side, using [this script](https://github.com/microsoft/DeepSpeedExamples/blob/master/applications/DeepSpeed-Chat/training/step3_rlhf_finetuning/training_scripts/single_node/run_13b.sh) and could not reproduce the same issue on my side!

Hi @joehoover, Thanks for using bringing up this challenge. I will definitely look into this and share more information on this. Best, Reza