Dustin Franklin

`lm_head.bias=False` and missing lm_head.bias weights

3

Hello! In this line of code, Bunny uses bias=False on the lm_head layer: https://github.com/BAAI-DCAI/Bunny/blob/9a15192ba6b54930fd5b692f0dbb8c9f18f6d714/bunny/model/language_model/bunny_phi.py#L32 However in the original Phi code, it uses bias: https://github.com/BAAI-DCAI/Bunny/blob/9a15192ba6b54930fd5b692f0dbb8c9f18f6d714/bunny/model/language_model/phi/modeling_phi.py#L969 I am trying [Bunny-v1.0-3B](https://huggingface.co/BAAI/Bunny-v1_0-3B) through various...