Question related to the model tuning

[shawnricecake]

Hi,

Great work first!

I am confused with the model tuning part.

According to the code, it seemed that you used the lora method. This, in my opinion, will destroy the sparsity you have made in the original model after merging the lora weights to the model weights.

could you explain this?

Thanks Shawn

[VainF]

Hi @shawnricecake, LLM-Pruner is a structural method and thus produces a dense model after pruning.

[shawnricecake]

Hi @shawnricecake, LLM-Pruner is a structural method and thus produces a dense model after pruning.

Hi, thanks for your reply, so, the model weights after merge the lora weights will be dense?

the main contribution of paper is the structure pruning?

Thanks Shawn