tensor_parallel
tensor_parallel copied to clipboard
fix recursion error when setting tp_wrapped_module #122
To fix the error mentioned in #122
This happens whenever the attribute tp_wrapped_module
is changed (for example inside LoRA or other PEFT methods)
I am not 100% sure this works as I have not started training yet but it has certainly made my example in #122 work as expected.