happy-for-you-every
happy-for-you-every
# 1. 修改模型权重加载 def parse_model_states(files, dtype=DEFAULT_DTYPE): zero_model_states = [] for file in files: # Modify model weight loading state_dict = torch.load(file, map_location='cpu', weights_only=False) # 添加参数 # ...后续处理... # 2. 涉及优化器状态加载,同样需修改...
# 1. Modify model weight loading def parse_model_states(files, dtype=DEFAULT_DTYPE): zero_model_states = [] for file in files: # Modify model weight loading state_dict = torch.load(file, map_location='cpu', weights_only=False) # Add parameters #...
# 1. 修改模型权重加载 def parse_model_states(files, dtype=DEFAULT_DTYPE): zero_model_states = [] for file in files: # Modify model weight loading state_dict = torch.load(file, map_location='cpu', weights_only=False) # 添加参数 # ...后续处理... # 2. 涉及优化器状态加载,同样需修改...