XiaoFengbing
XiaoFengbing
hi, i meet the same problem as yours. Because the `view` function need the tensor address is continuous, if discontinuous, you should add the `contiguous` function before `view` . Now...
Another question: In the LLMLingua and LongLLMLingua code, instruction and question seem to not be compressed. In other word, LLMLingua and LongLLMLingua only compress context/document/demonstration, do not compress instruction and...
Thanks for your response very much!!! Looking forward to updating your code soon for customizing the predefined compression ratios, I want to faithfully reproduce the LLMLingua and LongLLMLingua results according...
@iofu728 If I want to compress instruction and question according the predefined compression ratios in LLMLingua and LongLLMLingua papers, and **do not make any changes to the existing code**. Can...
Hi, @iofu728, thanks for your response very much! 1. I confused about `context_budget` after reading #7 and #12.   `context_budget` are different number in LongLLMLingua, so i am confused....