Are the embedding head weights published?

[fssh72]

Hello,

Here in eval_mteb.py, the weights of the embeddings (down) projection layer are loaded from embedding_head.bin. As far as I could infer this file is not published as a part of the GritLM/GritLM-7B model weights on the Huggingface hub.

Are these weights published somewhere? Can you publish them?

Kind regards,

-- Freddy

[Muennighoff]

GritLM/GritLM-7B does not have an embedding head; The embedding head is only present for the embedding head ablation from the paper corresponding to this model https://huggingface.co/GritLM/gritlm_m7_sq2048_medi_proj1024_gendups