tensor_parallel icon indicating copy to clipboard operation
tensor_parallel copied to clipboard

fix recursion error when setting tp_wrapped_module #122

Open Ar-Kareem opened this issue 10 months ago • 4 comments

To fix the error mentioned in #122 This happens whenever the attribute tp_wrapped_module is changed (for example inside LoRA or other PEFT methods)

I am not 100% sure this works as I have not started training yet but it has certainly made my example in #122 work as expected.

Ar-Kareem avatar Oct 02 '23 09:10 Ar-Kareem