transformers-bloom-inference icon indicating copy to clipboard operation
transformers-bloom-inference copied to clipboard

fix checkpoints file list to align with DeepSpeed

Open dc3671 opened this issue 2 years ago • 1 comments

When use glob.glob(f"{self.model_path}/*.bin"), files path in the list will all contain model_path prefix. While set it as root_dir will not. And it will align to DeepSpeed's loading way (replace_module.py):

sd = [
                    torch.load(os.path.join(base_dir1,
                                            checkpoint[i]),
                               map_location='cpu')
        ]

Where base_dir1 is duplicate with model_path.

plz help review @mayank31398, thx~

dc3671 avatar Mar 24 '23 03:03 dc3671

Hi, this repo is no longer maintained

mayank31398 avatar Aug 21 '24 04:08 mayank31398