wwh0411

First of all, thank you for your great contribution to the community. Since the prosperity of LLMs, many researchers are hoping to apply dp-based FL algorithm to this new setting....

slow inference with peft model

3

I use the code from fingpt benckmark to evaluate my peft model on datasets：fpb/fiqa/tfns respectively. However the inference speed is very slow, and increasing batch size doesn't help with this...