Efficient-LLMs-Survey
Efficient-LLMs-Survey copied to clipboard
There is a paper in structured pruning which I think is not related to Model Pruning
This Paper: Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models, arXiv, 2024 [Paper] I believe is using small model to pruning dataset in order to have a better performance in large model training. Should it be grouped into Data Selection scope?