Cyril Vallez
Cyril Vallez
> To pass the test of test_initialization and test_mismatched_shapes_have_properly_initialized_weights, I want to change/add to the code of `tests/test_modeking_common.py`. But this is common code. Could I change/add to the code like...
Hey, sorry for the delay! In order to use modular transformers, you need to create a new file, `modular_diffllama.py`, in which you can use inheritance from the different `Llama` classes....
You may need to rebase/merge on `main` though for modular to work perfectly as you seem to be a bit far behind. If something does not work as expected after...