Jesujoba Oluwadara Alabi

Hi @jaspock , I keep on getting `AssertionError: cannot find language token __en__ in the dictionary` during inference. Do you know why?

Thank you @jaspock , do I add those lines to dict both for both training and inference? I am not sure about the training tho

@calpt @hSterz , sorry to bother you here. Is this the same situation for adapters? Trying to leave_out some layers but they still show up to have adapters. And the...

@calpt , sorry to bother you. did you by chance check this?

Thanks for your response @calpt. I have made a PR So I was trying to train a German language adapter using the implemented GPTNeoX with the script below: ``` LANG="de"...

Hi @calpt, thanks for your feedback. I thought as much, I also noticed that they did not tie the weights of the input and output projection layers. Yes, I agree...

Checking again it appears it is not plausible to have it fixed within freeze_model(). `self` within `model_mixin.py` is the `base_model` without any prediction head (because the embeddings are not tied)....

Hi @TParcollet , is it possible to do batched inference using -- custom inferences?