Failed Compression Attempts with LLMLingua Web UI Demo

[cws322]

I conducted several prompt compression tests using the LLMLingua Web UI Demo (https://huggingface.co/spaces/microsoft/LLMLingua ). However, I encountered a situation where the context could not be compressed, despite testing with various compression ratios. Could the inability to compress the context be attributed to a model-related issue?

[iofu728]

Hi @cws322, in the HF Demo, LLMLingua assigns different compression ratios to different parts of the prompt, like instruction, contexts and question. Therefore, please place the content you wish to compress in the context section.

I hope this resolves your issue.