Wang, Yi comments

Results 69 comments of


                                            Wang, Yi

Enable autoTP for bloom

https://github.com/huggingface/transformers/pull/22196 has been merged

fix mpich launcher issue in multi-node

@delock @yao-matrix @liangan1

fix mpich launcher issue in multi-node

@jeffra could you help review？

fix mpich launcher issue in multi-node

https://github.com/pmodels/mpich/blob/main/src/pm/hydra/mpiexec/options.c mpich options

Update automatic-tensor-parallelism.md

@delock

fix regression in shard checkpoint loading in AutoTP Path caused by qkv_copy() is deleted and add UT case for shard checkpoint loading in AutoTP

@tjruwase @delock @yao-matrix

fix regression in shard checkpoint loading in AutoTP Path caused by qkv_copy() is deleted and add UT case for shard checkpoint loading in AutoTP

@tjruwase I added another commit for https://github.com/microsoft/DeepSpeed/commit/db26f8b41325be2a7f7af8b386b4e8951a5a76c9, the latest merged code suppose only KI path support shard loading, actually I have already added the support, see the usage in UT

ipex intel extension for pytorch integration

@pacman100 Hi, could this PR be merged now?

ipex intel extension for pytorch integration

Hi, @sgugger, could you help review it?

ipex intel extension for pytorch integration

@sgugger I rebase it and create a new PR https://github.com/huggingface/accelerate/pull/1255