DeepSpeed-MII icon indicating copy to clipboard operation
DeepSpeed-MII copied to clipboard

Is the DeepSpeed-MII will support habana (HPU) hardware?

Open muhammad-asn opened this issue 1 year ago • 2 comments

Currently the TGI have tgi-gaudi to support the HPU for Gaudi 2 and also VLLM is included their roadmap in Q1 2024

Is the DeepSpeed-MII will support habana (HPU) hardware as well?

Thank you

### Tasks

muhammad-asn avatar Feb 21 '24 03:02 muhammad-asn

We are currently working on support for HPU hardware on the training side of DeepSpeed. I expect we will also work towards supporting it for inference as well, but we do not have any set goals/deadlines around that support at this time.

mrwyattii avatar Feb 23 '24 18:02 mrwyattii

@mrwyattii thanks

muhammad-asn avatar Feb 26 '24 04:02 muhammad-asn