Avkash Hirpara

> Hi @lucasjinreal, > > Thank you for your question. I believe that LLMLingua & LongLLMLingua can retain most of the information even when compressing very long prompts. > >...

Facing the same, tried uninstalling and installing the torch but error is the same. I do not have the nvidia gpu or cuda platform in my PC. is there a...

> JiHa, try with a different LLM for the compressor like below: > > from llmlingua import PromptCompressor llm_lingua = PromptCompressor("TheBloke/Llama-2-7b-Chat-GPTQ", model_config={"revision": "main"}) > > You should try the notebook...