SVD-LLM icon indicating copy to clipboard operation
SVD-LLM copied to clipboard

Table10 and Zero-shot performance

Open hsb1995 opened this issue 11 months ago • 2 comments

Our team highly recognizes your work. You are currently the best at matrix decomposition. How can I reproduce the generation task in Table 10?

I have read your code in detail. Is there no such code in the Zero-shot task?

hsb1995 avatar Jan 20 '25 03:01 hsb1995

Have similar problem, I was wandering about how to prompt the pre-trained LM so that the response is in a good and reasonable format for your accuracy evaluation reported in the paper, thanks.

SpeeeedLee avatar Mar 03 '25 10:03 SpeeeedLee

Have similar problem, I was wandering about how to prompt the pre-trained LM so that the response is in a good and reasonable format for your accuracy evaluation reported in the paper, thanks.

Hello, this paper states that no matter what, the. pt file is saved in the end, and then Lora needs to fine tune it. He said that the fine-tuning code is copied from LLM Pruner, and we can see how LLM Pruner evaluates zero shot to solve this problem.

hsb1995 avatar Mar 05 '25 09:03 hsb1995