DeepSpeedExamples icon indicating copy to clipboard operation
DeepSpeedExamples copied to clipboard

async_pipeline is not exposed in the library

Open yaliqin opened this issue 1 year ago • 1 comments

Hi team, I want to use async_pipeline and find mii.async_pipeline is not exposed out with the deepspeed-mii package. Can you add this in the code https://github.com/microsoft/DeepSpeed-MII/blob/main/mii/init.py#L6 ?

Thanks

yaliqin avatar Dec 20 '23 21:12 yaliqin

@yaliqin please post MII issues on the MII repository.

You can import with from mii.api import async_pipeline. However, please note that this is only intended for internal use (so we will not expose in the __init__.py file) and is very much tailored to work with the inference server in MII.

mrwyattii avatar Jan 04 '24 18:01 mrwyattii