anon.W

Results 2 issues of anon.W

**Describe the bug** ``` Traceback (most recent call last): File "deepspeed_inference_demo.py", line 16, in ds_model = deepspeed.init_inference( File "/root/anaconda3/envs/py38deepspeed/lib/python3.8/site-packages/deepspeed/__init__.py", line 333, in init_inference engine = InferenceEngine(model, config=ds_inference_config) File "/root/anaconda3/envs/py38deepspeed/lib/python3.8/site-packages/deepspeed/inference/engine.py", line...

bug
inference

Can MeZo be used on NLG tasks? I integrated the _inner_training_loop part of the code and the methods it relies on into the NLG task training code, and performed fine-tuning...