sjkoo1989

same here. My scripts looks like below ``` from diffusers import StableDiffusionPipeline import deepspeed .... async def startup_event(): app.state.pipe = StableDiffusionPipeline.from_pretrained( settings.model_name_or_path, revision="fp16", torch_dtype=torch.float16, ).to(settings.device) deepspeed.init_inference( model=getattr(app.state.pipe, "model", app.state.pipe), #...

I used Python 3.10 with requirements settings below ``` fastapi==0.86.0 pydantic uvicorn==0.19.0 accelerate diffusers torch transformers deepspeed triton==2.0.0 ```

``` File "/./app.py", line 51, in startup_event deepspeed.init_inference( File "/usr/local/lib/python3.10/site-packages/deepspeed/__init__.py", line 311, in init_inference engine = InferenceEngine(model, config=ds_inference_config) File "/usr/local/lib/python3.10/site-packages/deepspeed/inference/engine.py", line 139, in __init__ parser_dict = AutoTP.tp_parser(model) File "/usr/local/lib/python3.10/site-packages/deepspeed/module_inject/auto_tp.py", line...

It looks like the bug could only be reproduced in version 0.8.2 or later. (the bug does not rely on the version of diffusers)

Follow version settings work ``` accelerate diffusers==0.6.0 torch transformers[sentencepiece]==4.24.0 deepspeed==0.7.4 triton==2.0.0.dev20221030 ```