PaddleNLP
PaddleNLP copied to clipboard
Adding LoKrModel Class to paddle.peft library
PR types
New features
PR changes
Others
Description
Adding LoKrModel, LoKrLinear and LoKrConfig to support a new lora-like adapter. Current implementation only supports contains Linear Modules. Motivation and discussion on such PR issue is at: https://github.com/PaddlePaddle/PaddleNLP/issues/9226
Please provide suggestions on the current implementation!