LLMLingua icon indicating copy to clipboard operation
LLMLingua copied to clipboard

How can I speed up using llmlingua2 ?

Open yyjabiding opened this issue 6 months ago • 2 comments

Describe the issue

I have a context length of about 100k. Is there any methods that I can do to speed up using llmlingua2 to compress it and keep it within s short time like shorter than 2 seconds?" Thanks.

yyjabiding avatar Aug 06 '24 03:08 yyjabiding