Boyue comments

Repositories
Issues
Comments

Results 2 comments of


                                            Boyue

ImportError when using `weight_diff.py` script

I encountered the same problem and I guess cuz openai upadte their module. If you only want to recover the weight, you can just delete the code in utils.py that...

weight_diff.py state_dict_recovered[key].add_(state_dict_raw[key]) RuntimeError: The size of tensor a (32001) must match the size of tensor b (32000) at non-singleton dimension 0

I encountered the same problem. When I check the source code, I found that relates to the format of the model.state_dict. So you should check the state_dict shape of the...