cornzz comments

Repositories
Issues
Comments

Results 35 comments of


                                            cornzz

Multicore prompt_compress

Hi @SrdanProdanovic, this looks cool! Do you have some benchmark numbers, did you actually manage to speed up the compression process? I see that you parallelized the calculation of the...

Fix prompts smaller than iterative_size not being compressed

@iofu728

[Question]: Reproduce end2end latency results of LLMLingua-2

Thank you very much! 🙂

[Question]: Reproduce end2end latency results of LLMLingua-2

@pzs19 @iofu728 sorry, a follow up question: which LLM was used for compression in the end-to-end latency benchmark of the original LLMLingua paper? Under "Implementation Details" it says > In...

date-fns console outdated / broken

Issue was already opened here: https://github.com/date-fns/date-fns.org/issues/222