Huiqiang Jiang comments

Results 154 comments of


                                            Huiqiang Jiang

[Question]: How to combine longllmlingua and llmlingua2 ?

Hi @qminh369, thanks for your support in LLMLingua. Currently, the pip package does not support using LongLLMLingua and LLMLingua-2 together. However, you can use them separately: 1. First, use LongLLMLingua...

[Question]: error when compressing long prompt with LLMLingua1 & LongLLMLingua

Hi @jiushuw, thanks for your support and feedback. Hi @frankjoey2048, thanks for your contribution. We'll try to fix this issue.

[Feature Request]: How to improve the accuracy of compressor for large SFT models through training

Hi @dingjingzhen, thanks for your support in LLMLingua and your suggestion. The best-performing compressor currently is “llmlingua-2-xlm-roberta-large-meetingbank.” I believe your idea is promising, but implementing it will require some design...

Plans for paper or technical report

Thank you for your excellent idea. However, I'd like to kindly point out that this concept may be very similar to 'Aggressive Decoding' https://arxiv.org/pdf/2106.04970.