DeepSpeedExamples
DeepSpeedExamples copied to clipboard
async_pipeline is not exposed in the library
Hi team, I want to use async_pipeline and find mii.async_pipeline is not exposed out with the deepspeed-mii package. Can you add this in the code https://github.com/microsoft/DeepSpeed-MII/blob/main/mii/init.py#L6 ?
Thanks
@yaliqin please post MII issues on the MII repository.
You can import with from mii.api import async_pipeline. However, please note that this is only intended for internal use (so we will not expose in the __init__.py file) and is very much tailored to work with the inference server in MII.