larekrow

[BUG] deepspeed.init_inference() erroneously attempts to copy out of meta tensor

7

**The bug** In `deepspeed.module_inject.replace_module.py`, `replace_module()` is being called on meta tensors before the actual weights are loaded just a few lines below, resulting in `NotImplementedError: Cannot copy out of meta...