Alex Falconer-Athanassakos

icon company Resolver Inc icon location Kelowna, BC icon location Machine Learning Engineer in Western Canada.

Results 1 comments of Alex Falconer-Athanassakos

Missing key(s) in state_dict for bias in attention blocks

> Adding the parameter `strict=False` parameter in line 70 of `utils.model.model_utils.create_critic_model` lets me load the checkpoint: > > ``` > def create_critic_model(model_name_or_path, > tokenizer, > ds_config, > num_padding_at_beginning=0, > rlhf_training=False):...